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ABSTRACT 

A seainar was held in March, 1976, at the Association 
for Educational Coaeunications and Technology (AECT) Annual 
Convention to discuss the probleas of nonprint aedia selection. The 
aajor guestion raised in the seainar was the extent to which an 
economical inforiation systea to provide qualitative as well as 
purely technical descriptions of educational aedia to users was 
possible. The concerns of users of such a systea were addressed by a 
panel of participants froa (1) an education/library group; (21 a 
United States Governnent group; (3) an entrepreneurial inforaation 
group; and (4) a conercial publisher and data systea: entrepreneur 
group. The short papers that contain' the viewpoints of the 16 panel 
aeabers are collected for this report, along with an introduction, a 
suaaary of findings, a bibliography, and a directory of related 
organizations. (HAB) 
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I . "BACKGRQUND 



- Library/media specialists; teachers, and others need help choosing nonprint 
media software for purchase^ rental , or curricular use. Nearly always, educa- 
tors need to ascertain in advance that considered items meet designated criteria 
Unlike the print side of the media field, which through the years has developed 
an extensive array of useful bibliographic tools and serVices to meet this need 
the nonprint media side has few such tools. 

• It is true that much has beenJfritten on the general subject -of nonprint 
media selection, including recojpyffded criteria and procedures. But several 
obstacles limit the ability toWoise media with the consistent assurance that 
items selected meet educational requirements and standards. In the first place, 
the sxipply arid variety of new nonprint media seems never to slow; funds, to buy 
them seem never to be enough; and the need for dependable information about non- 
print media compounds with the passage of time.. ? 

A further problem arises from efforts *to provide individually tailored 
learning experiences to match student needs, interests-, and abilities. The com- 
plications of media selection which have accompanied this emphasis on individ- 
ualization are, in direct contrast to those encountered by teachers when choosing . 
items for , large- group instruction. 

Complaints regarding nonprint media selection practices take several tacks. 
From the user's point of view the following dissatisfactions are common: 

The speed and Volume of nonprint educational media production in 
the United Sjtates creates a glut;, there are simply too many items 
to keep up with, to know about, or to have bases for purchase, rental, 
or use. j 

* Information sources available to. nonprint media purchasers, while 
helpful and better than those of a few years ago, vary in their up- 
to-dateness, cost, accuracy, availability, ease of use, arid com- 'I 
prehensiveness . 

'••'*' •• v • " i 

* Almost without exception, these information sources are distributed 
as printed products- -periodicals, serials, or one-shot productions. 
As a consequence, they are to some extent outdated even before they 
are printed. > ' 

* Even the purely descriptive information supplied by nonprint media 
producers themselves often tends to be incomplete, lacking such 
essential information as production date, results and uses of for- 
mative evaluation data, exact title, and cost. 

* Much of the current information concerning qualitative charac- 
teristics of nonprint media is based solely on opinion (as opposed 
to objective evaluation and^ assessment). And that. opinion is 
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generally of one person or group Who may be neither expert in the 
subject nor aware ofror sympathetic to the item's purpose and in- 
structional design. ' + 

The rating (evaluating, assessing, and critiquing) of new media resources 
is itself a ticklish procedure. Producers of new products --usually with a 
promise of only limited returns^-are understandably reluctant to see them down- 
graded by reviewers, however expert they may be. This is especially the ckse* 
when such evaluations are made for purposes or audiences not envisaged in the 
original design of the prdducts. 

Many publishers and producers of nonprint educational media also believe 1 
that the worth of their product cannot be assessed appropriately apart from the 
particular situation, teacher, and student activities associated with its use. 
How an item is used, they say, is the key; poor utilization practices lead to 
poor results no matter how intrinsically good the item may have been judg;ed. 

For these and other reasons* then, large numbers of producers and consumers 
alike agree that there is no suitable substitute for requiring local pre-purcha£< 
previews, even though the practice is expensive/ time-consuming, and cumbersome. 
Clearly, though, few of these producers and consumers would \argue for €he alter- 
native of big-government "efficiencies" in regulating and controlling the pro- 
duction and purchase of nonprint media. Other more viable alternatives must be 
found, c 

It was with these and other similar problems in mind that the Seminar on 
Nonprint Media Information Networking was held as a concurrent program element 
of the national convention of the Association for Educational Communications aijd 
Technology, Anaheim, California (March 30, 1976). The ERIC Clearinghouse on 
Information Resources (ERIC/IR) at Stanford University acted as sponsor and host 
for the meeting. 

Se minar Purpose 


The purpose of the seminar was to draw upon the expertise and backgrounds of 
individuals representing significantly important facets of the educational media 
field as lasers or producers of information about the quality of nonprint instruc- 
tional materials. 

In its simplest form, the question addressed by the seminar participants 
was : 1 

Is it possible (and desirable) to develop a 
compatible and economically feasible system 
capable of obtaining* storing* and selectively 
retrieving dependable qualitative (as well as 
technical or purely descriptive) data about 
specific nonprint media items? 

Pending development of a suitable answer to that question, several other 
sub-questions were to be considered: 

If not* why not? If so* what should be 'the ^ 
characteristics of such a system? How might 
it be organized* administered* and supported? 



Selection of Participants 

It was decided at the 'outset that the sole concern of the ERIC Clearinghouse 
on Information Resources in sponsoring andynanaging the seminar was simply to 
serve as a catalyst-to bring together inffvlduals representing -several levels 
and typ,es of interests manifested by professionals and organizations in the 
educational media field. ERIC/IR would have no preconceived point of view on 
answers to the above questions. 

Four categories of participants were subsequently defined: (1) an 
education/ library user group, (2) a U.S. Government group, (3) an entrepreneurial 
information group (media information producers), and (4) a commercial publisher 
and data system entrepreneur group. Participants and organizations represented 
were: . 

Education/Library Users 

Stephen C. Johnson, President, Educational Film Library Association 
(EFLA) 

Will D. Philipson, Chairman, Data Bank Committee, Consortium of 
f University Film Centers (CUFC) * . ' 

Clint Wellington, Director of Research and Communications, Association 
for^Educational Communications and Technology (AECT), 

Robert E. Muller, District Librarian, Jefferson Elementary School 
District, Daly City, California 

Robert C. Gerletti, Director, Educational Media Services, Los Angeles 
County Schools 8 

Irene Wood, Nonprlnt Reviews Editor, Booklist Magazine, American Library 
Association 

r 

U.S. Government Group 

i. *■ - * 

Jean McCauley, Chief, Information Branch, National Audiovisual Center, 
National Archives and Records Service 

Charles N. Farmer, Jr. , National Medical Audiovisual Center, National 
■ r » Library of Medicine *. 

Carl F. Oldsen, Assistant Director, Information Services, National Center 
on Educational Media and Materials? for the Handicapped (represented 
by Joseph Florio) 

Lenore S. Maruyama, MARC Development Office, Library of Congress 
(represented by Vivian Schrader) 

Entrepreneurial Information Group (Media Information Producers) 

M. Thomas Risner, Director, National Information Center for Educational 
Media (NICEM) 

William J. Speed, Audio-Visual Associates, Inc., publishers oi Inter- 
national Index to Multi-Media Information and MEDIAFILE 



P. Kenneth Komoski, President, EPIE (Educational Products Information 
Exchange institute), "consumer's union"-like evaluations of media 
software and hardware, plus other product information-related services 
to member schools and colleges 

C. Edward Wall, editor of Media Review Digest (unable to attend) 
Commercial Publishers and Data System Entrepreneurs 

— - • ■ - 1 ** "V 

David Biesel, Senior Editor, Macmillan Information, publishers of 

Current Index to Journals in Education (ERIC) , Thesaurus of ERIC 
Descriptors , and related items 

Andrew H- Uszak, Vice President, R. R. Bowker Company, director of com- 
puterized data base publishing including Books in Print and Subject 
Guide to Books in Print 

C. Walter Stone, President, J-MARC, Inc. 

Seminar Management Plan 

It was the plan of the seminar that the discussion question be explored. 
Time tthree hours) was much too short to expect definitive answers or plans. 
To obtain the most from the group in the allotted time and to provide time to 
exchange views and to elaborate points, each discussant was invited to express „ 
his or her views and to report, nonprint media assessment activities or problems 
in a bri^f (UOOO-word) paper. This paper was <to be circulated to ail partici-. 
pajits prior to the seminar. An invitation alsoXwas extended to each participant 
to include in l\is or her paper concrete suggestibn&>about ways to solve, or at 
least to ameliorate, qualitative nonprint media assessment problems. Writers 
were informed that seminar time would be provided to qffer further information 
or to elaborate 6n points. Participants were ui^gedXto query each other ^id to 
take issue with a^id "piggy-back" on each others 1 idelas. Audience participation 
was expected to b6 relatively light; insofar as possible emphasis would be upon 
permitting seminar participants to hear each otl(ier and to exchange views. 

■ v 
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II. viewpoints: 
education/library users 



Six education/ library users of available information about nonprint - 
educational media resources expressed viewpoints first. Each speaker had 
been invited to describe the state of the art of obtaining, processing, and 
using such information in his or her organization or institution. -Each was 
asked, too, to indicate why that particular organization chose the approach to 
data management that it did, to indicate areas of satisfaction or dissatisfajction 
with that approach, to suggest ways the system could be improved and, if 
appropriate, to indicate ways the organization might contribute to any media 
information system suggested as an 'outgrowth of the seminar. / 



THE EDUCATIONAL FILM LIBRARY ASSOCIATION'S 
CONTRIBUTIONS TO FILM INFORMATION ^ -I 

Stephen C. Johnson, President 
Educational Film Library Association 
New York, New York 

(Director of Fiold Services, Audiovisual 

Center " 
Indiana University) 



The 2,000 members of the. Education^ iFilm' Library Association (EFLA) are 
divided rather evenly among institutions of higher education, schools, and 
public libraries-museums-community programmers. These institutions and indi- 
viduals joined together in 1942 to provide for themselves several services not 
otherwise available. EFLA was founded and continues to flourish as a clearing- 
house of information about the utility and availability of :16mm films, although 
it also conducts other related activities. 

Provision of evaluative arjd descriptive information about films is per** 
vasive throughout the entire EFLA program. Involved are such* activities and 
services as: publication of , Sightlines , the Association's quarterly membership 
magazine; sponsorship and management of the American Film Festival; a film 
evaluation service program; workshops and institutes for a continuing education 
program for EFLA members; a comprehensive publications program; a library and 
information-reference service; and a newpFevi'ew series. 1^ 

American Film Festival ' 

The 800 or more educational films, entered each year ^irf the American Film 
Festival are evaluated by EFLA field juries prior to their b^ing judged by panel 
of content, production, and utilization experts,' assembled in New York City. 
Descriptive and qualitative data about' all films rated during this process are 
available now only in EFLA headquarters. The organization is negotiating with a 
commercial publisher to produce a new EFBA Fi%m Guide in which data about 
Festival entries will' be available on an annual or biannual basis. 

Sightlines and Other' EFLA Publications 

EFLA's membership quarterly, Sightlines, regularjy carries filmographies 
on special subjects prepared by experts. In addition, it features a pullout 
section which supplements the classic James Limbacher reference tool, Feature 
Films on §mm and 16mm. "The Filmlist," a regular Sightlines feature, offers 
annotated^ descriptive information, about the availability of approximately 200 
new films in .each issue. It is indexed annually in Sightlines, - 

Other EFLA publications issued from time to time are designed to provide 
film eyaluation, utilization, avaj. lability, and descriptive information to 
members and to others on topiefal and programmatic bases* Such topics as the 
following have been treated: the space age, films on war and peace, minority 
films, movies about movies, man and his environment, video and cable, films on 
death arid dying, alternatives, American Issues Forum filmjist, arid .others. A 
handbook stressing the why and how of EFLA film evaluation also has been pro- 
duced to guide and train members in the processes of creating and using such 
data. * V > 



EFLA Film Evaluation Service Program 

u<; fl hifi!^ ^ Eval " ation Service Prograni.which provides members with reliable, 
fll fl ««™ * rr%^ d evaluative ^formation about films, has been conducted 
for approximately 30 years. What has resulted from this effort is a cumulation 
of data about some 10,000 film titles compiled from reviews conducted by EFLA 
ro!^L thr0Ugh0Ut . the . C0Untry ' ^der this program, approximately 50 review 

sta^dardn e rP P r A CtlVe ^ ^ ^ fUm releases « ^ them using 

standardized EFLA procedures and criteria, and submit their results to EFLA 

mon?2^o r fl S n JUfT *V 2™ 1 Pr6pared in Card P acket form mai1 ^ 
nrnMh^tl^ EFLA members. They are indexed annually. Lack of funds has 

?h? J k 1S ! Uing !- third su PP lemen t to the Film Evaluation Guide which, with 
t?onr b e^ d ^6ln d n ?974 W ° Uld ^ P^Ucation of all EFLA evalua"- . 

EFLA Workshops and Institutes ' ' * 

* Ki- T J 6 P rin ^P al EFLA workshop and institute activities have to do with es- 
tablishing and refining film evaluation standards and procedures, film d'istri- ' 
?.nni° n mana S ement > f i lm reviewing, or utilizing films. Recent emphases have been 
upon^such topics as "personal cinema in public places/' 16mm distribution prac! 
lltlLf ^ erest *° fUnraiakers, alternatives in society, film library adminis- 
lllll v l m P r ° ductl0n » evaluation, minority films, and films on war and 

5! 3 i SUC 5 P r °e ram has resulted in a correlated publication containing 

detailed filnj- information for distribution to the field. 

EFLA Library and Information Reference Services 

A professionally-staffed, response-oriented information referral system 
maintained in EFLA 1 s New York headquarters features such media-related services 
as telephone reference, mail reference, publicity reference, film evaluation 
reference, and general media reference based on a model library whi^h includes 
more than 600 books and standard reference tools, a file of more thfc 4 000 
producers, a subject file of news releases, a similar filmography file, 'a film 
distributer catalog file, a vertical' file of pertinent articles and literature 
an equipment file, a periodicals resource collection of more than 150 titles, ' 
and card files for more than 50,'000 EFLA, Library of Gongres.s, American Film 
restival, and other entries. 

Preview Series: .A Special Service 

nTHn ^ r i Va ^ I f i ; mmakers seeking distributors for their productions often submit 
prints to EFLA headquarters, which then mails monthly catalog-entry listings of 
them to all service members as well as to n^n-theatrical film reviewers, to film 
programmers for museums and other potential showing locations and institutions 
and to other interested persons subscribing to the service. Screenings of these 
films are held regularly in New York City. 

* *.j * 

EFLA continues to be alert to ways it can best serve its members and the 
tield. Evaluations are currently under way regarding automatic data processing 
electronic and microfiche techniques and equipment, and other developments 
ottering alternative means of disseminating the nbnprint data EFLA develops 
The scope and efficiency of our services could be much increased by creation of 
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a national nonprint data base. Our own staff has discussed such a project 
and done some preliminary research on it, trying to determine what exists. % 
We believe that what is now needed is" a nonprint equivalent of Books in ^ 
Print. To V be truly useful, the proposed- data base sfibuld provide, access to 
films by subject as well as by title and director. We also believe that the • 
only efficient way to compile an accurate, comprehensive data base is to start 
with the catalogs of ^he United States (and Canadian) distributors, then a^id 
data on independently-distributed films as that information becomes available.. 
An alternative approach would be to obtain the cooperation of the United Stated 
Copyright Office and use copyright registrations as the data base. *To attempt • 
to build a national data base*by combining existing data bases *wou Id only 
compound the problems. 0 . « , * 

EFLA is willing to cooperate with other agencies in' seeking funding and 
working toward the establishment of such a national computerised nonprint ? 
data base, f ^. •„ 



COOPERATION UNIFIES FILM CENTERS 

Will D. Philipson, Chairman 
Data Dank Coroaittee 
Consortium' of University Film Centers 
(Director, Audiovisual Library Service, 
University, of Minnesota) 



The Consortium of University Film Centers (CUFC) is a cooperative organi- 
zation of 43 institutions of higher learning that maintains 16mm film rental . 
libraries. CUFC institutions are now working together in efforts to raise 
standards and to solve certain film rental library problems that are common to 
all. 

'*•.»* * 
. Film Locator Project 

One of CUFC's most significant recent projects is its plan to publish 
what will be known as The Film Locator (Bowker and Company). It will list and 
describe all of the 16mm rental titles offered by all 43 Consortium member 
institutions. This is to-be done because CUFC members believe it is necessary 
to bring together in a single authoritative volume essential data about 16mm 
films known to be distributed widely to users whom CUFC institutions have 
served for, so long. / \, t 

r3liK^- Pa ! 3 Ban ! t Committ ? e ; ^ ic « %4one much of the work on the Film 
Zoom* project, seeks through i%$ efforts* to raise standards and to systematize- 
in desirable ways the development .and utilization of film cataloging information. 
Him Locator listings will contailnot Only technical, descriptive, artd utiliza- 
tion data for each title; they will also identify CUFC member institutions that 
hold one or two prints of it. This plan of operation Will permit, among other 
things, transfer among members of rental requests, that cannot be filled in one' 
location because of prior bookings. To accomplish this, all CUFC members 
holding titles in question will be coded to facilitate s reference search to 
locate nearest convenient sources. The*overall intent with respect to Film - 
Locator listings will be to provide information needed by potential users to 
judge, m advance of preview, whether particular items are likely to suit their 
purposes. • 

Developing the Pool -Plan 

In developing the pool plan, Consortium members experienced a number of 
problems which are likely to encountered in any such cooperative endeavor to 
share data services. There was first the matter of obtaining member consensus 
to participate m the project. Other problems related to*K Seeking and obtaining 
full disclosure rights to each university's computerised film catalog data 
base; prioritizing the use of catalog entries by source; Convincing a publisher 
to risk capital and to trade publishing expertise for cataloging expertise 
(itself valued, in this case, at $250,000); finding means to retain control of 
the data base for possible future utilization in other networks; and finally 
working out a plan to share equitably any revenues that might accrue to the 
organization. • \ 

CUFC members are convinced that the plan that has emerged will provide a 
useful service to no.nprint-iiedia users. They also believe that the standardized 
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data base that results will bring participating university film libraries 
close to autpsaated networking as well as provide a potentially useful resource 
for* oth^r types of inter-institutional and inter-organizational Cooperation 
which Bay be needed to effect any truly coiaprehensive nonprint data base 
opefation^in this country* 

* ■ ■ ' / • •• •■ ■ 
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AECT AND- NETWORKING i A STATUS REPORT FOR 1976 
Clint Wallington 

Director of Research and Communications 
Association for Educational Communications 

and Technology 
Washington, D.C. • ' 



tin6t limitations. 
stim helps only if 
iation about ERIC. ' 



Someone asking for the policy of the Association for Educational Communica- 
tions and Technology (AECT) on networks would get no answer,- -or 'several. One 
reason for this is that "networks" and "networking" cover an incredible range of 
topics, projects, and activities. AECT is involved in networking through its 
activities in the area of cable broadcasting, cataloging, diss/mination of in- 
formation about networks, and others... As various parts ef the Association push 
forward in a number of different areas, the Association as a/Whole is/ beginning 
to pull things together to/coordinate its work in the networking field. 

The Language of Networks • 

One of the first things we have had to do is. to 6omf to grips with the 
language of networks and through that to examine the/"kihds" of networking that 
exist. The numerous concepts referred to under tho single . label, "network," 
often make communication difficult. There seem to/be At least five ways of 
describing and classifying networks. Any particular network may be described by 
one or more of the following: 

* By name. This can be^helpful but has di 
Describing ERIC/IR as part of the ERIC 
you have the requisite background infoi 

* By communications link or delivery mode > /Knowing that someone 
has a teletype network or a computer /network offers one common 
denominator for comparing networks and dan tell some of the 
network's potentials and constraints. /But this is of more interest 
to network planners than to users./ 

/ 

* By structure. Understanding how,a network is organized— e.g. , as 
a centralized data source or as fx loose confederation of institu- 
tions—is of particular interest to network planners and administra- 
tors. ) , „ / ' 

* By content or\specialized purpose/ Separating "medical information 
networks" from the "education" networks is critical from a user 
point of view. The sam^iS /true of separating networks with 
original source document from/networks with information about 
original sources. However, some confusion in describing a network 
by its content may arise whW a network accesses a number of 
different content areas. 

• * By what the network interfaces^r links together. That is, who 
talks to what? (Or what talks to whom?) Is it a network linking 
people.. .computers. . .special computer peripherals? 

[The above descriptions are/informal expansions from the Article "Information 
Networks in ^iomedicine" o by WMliam L. Millard in the Journal of Biocommmica- 
Uono, Vol. II, No. 3, November 1975, pp. 7-14.] 



AECf and Networking / - v . 

Tire foregoing descriptive classes are, indeed, rough. "They are only 
starting points. But their value should be obvious. They allow the grouping 
of similar networks and help people to more clearly identify their own interest 
areas in networking. Using some sort of common terminology or descriptions 
will serve to reduce communication error. Clearing up terminology and related 
classification and description activities" is becoming one of AEGT's priority 
activities. Actually, almost any set of interconnections with flow can be 
called a network. Operationally, however, AECT's interests generally lie with 
networking that has most (if not all) 4>f the following characteristics [as 
adapted from R.C. Swank's article, "Inter library Cooperation, Injter library 
.Communications, and Information Networks --Explanation -and Definition," pp. 18- 
26/ in Interlibrary Conrnmications and* Information Networks, Chicago, 111. : 
American Library Assn. , 1971, 347pp.]: 

* Users are geographically separated from the information they seek. 

* An organized body of information is available; it may be in several 
different media formats. 

* The organizational Scheme employed permits users to locate needed 
information. 

* Direct, two-way communications is provided between the user (or 
person accessing the information) and the information source. 

* The information is delivered electronically. 

The preceding element's more or less shape AECT's approach to the field of 
networking. AECT member^* interests focus on networks dealing with the content 
area of education, media, and library science; on the use of networks for the 
•purpose of delivering learning materials or modules as well as for assisting 
educators in research, in teaching, and in decision-making. Our members tend to 
show Strong interest in the interface between network and user, as learners 
access a variety of media and a higher degree of interest in the electronic 
or computer -based network mode than in teletype networks. At this juncture, net 
work structure does npt seem to be of primary interest. We are interested in 
learners using both Networks which give information about learning resources and 
networks which can jdeliver resources themselves. 
/ 

AECT Networking Activities 

How, then, are AECT members, committees, and staff involved in networking? 
Several activities may be mentioned. With the assistance *of the USOE-funded 
Leadership in Library Education Institute (Florida State University), AECT has 
developed and is distributing a 35mm sound filmstrip, Networks for 'Learning. 
It preseiyts basic information about networks, particularly as they rebate to 
learners, learning resources, and instruction. 

AfeCT maintains close ties with the National Commission on Libraries and 
Information Science (NCLIS), offering suggestions and comments and reviewing 
NGilS jputput . It also works with the Educational Resources Information Center 
, (ERIC) system, and* especially with the ERIC Clearinghouse on Information 
Resources (Stanford University), helping to disseminate information, offering 
suggestions for activities, referring individuals and queries to the unit, and 
conducting joint projects. Contact is maintained with other ERIC Clearinghouses 
as well. ' *j ^ '* 



AECT's most recent networking activity was not intended primarily to be 
.that, ^ We have just released the 4th edition of Standard® for Cataloging 
NonpHnt Materials. Its rules were ,not designed specifically for use in 
cataloging materials in networks but there was a conscious attempt to make 
them usable for that purpose. 

Still another AECT involvement with networking may be mentioned. The hew 
National Center for Educational Statistics (NCES) handbook of terms and 
definitions in educational technology wa£ developed for use in data collection 
for statistical purposes. However, as networks begin to collect and exchange 
information about educational technology, they need hierarchically-arranged 
standardized terms wijm mutually exclusive definitions. When developing the 
handbook -for NCES, AJKCT was aware of the implications for networks buft it did 
not consider the project a "networking project." Similarly, the AECT Committee 
on the Evaluation 6f Instructional Materials will consider standardizing ways of 
reporting materials evaluations. Though not actually a "network" committed, * % 
the committee's output could materially influence networks* content and proce- 
d,ures'> / 

; Currently, AECT is working with NCLIS to explore and develop a plan for 
:a nationwide system—or "network"-- for nonprint materials. 

But by far the greater portion of AECT's networking involvements lies with 
individual member activities. These are the practitioners, the people who 
deal directly and specifically with networks of all kinds. It is the sum of vv ' 
these activities and concerns which moves and directs AECT in its relationship i 
with the field. There is little doubt that networks will continue to^increase 
in number, in coverage, and in sophistication of their organization and manage- 
ment. AECT's primary tpsk is to do what it can to ensure that tji^y reach their 
fUll potential in the service of media professionals, educatoaps^'and learner^. 
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Information about nonprint educational media: / 
;fhb consumers point of view ' ; 

Robert B. Muller, District Librarian 
Jefferson Elementary School District 
Daly Gity, California 



I presume that I am here speaking for the little guys, the school district 
library/media specialists, the librarians at the school building level. At the 
outset, there are some thipgs you should understand about usV First \ we tend 
to be interested mainly in the small, inexpensive media: filmstrips, study 
prints, recordings. These are the things we buy. k We are not much into the film , 
market. We get our films from a county or regional film library j they are too 
expensive for us to buy locally. The more exotic instructional media aro even j, 
further from our everyday lives. Second, we tend to be isolated from much that 
you might think is available to us in the way 6f selection tools. They are 
available, yos, but they are located in district or county professional libraries, 
far removed from our worksites. Again\ pur financial resources are extremely 
limited, and getting to be jnore so. The lavishly financed media libraries that 
we read about are not really all that numerous; most of us have only a few 
hundred dollars for medii, and it doesn't go far. 

Our Main Problem 

But perhaps our main problem is that so many of us tend not to have had 
very much experience in -the nonprint media business. We are book-oriented 
librarians, and as such, our backgrounds an<J experiences with audiovisual media 
are quitfe limited. Younger, newer school librarians may have had SomO new 
media coursework in library school, but even they have had relatively little 
actual experience with new media, at least iir comparison with the expedience 
they have had with books. . * 

How are school librarians to acquire this experience? Our workload is 
already seriously overextended by all of the' technical, * administrative, pro- 
fessional, and teaching responsibilities of an institutional library that 
usually fall on th? shoulders of just one person. So, being librarians, we 
turn for help to review journals, evaluative resources, and selection tools, 
and we find them distressingly meager, too often inadequate, and almostNalways 
priced beyond our means. Even a modestly, good collection' of book and media 
selection tools wotild take all of our materials budget. So we make do with 
relatively inadequate resources for selecting the few media we are able to buy. \ 

How We Evaluate and Select Nonprint Media 

A study of actual nonprint media evaluation and • selection practices of our 
schools, and of buying habits with respect to them, would reveal interesting, 
perhaps shocking, information. I am sure we would find, for example, that the 
most important factors in selection decisions are statements in producers 1 
catalogs and of persuasive' sales representatives, combined with results of local 
previewing. We'buy books from reviews others have done > and this poses us no 
problems. We have good, dependable reviewing sources; we know them and we trust 
them* If, occasionally, we goof with a useless or inappropriate book, it is a 
matter of only a few dollars. But with nonprint materials we can f t afford to 
miss— as in buying an expensive set of useless filmstrips, for example. We have 



not yet come to depend on media reviews, so we preview. Previewing is not only 
the traditional way of evaluating and selecting most audiovisual media, it is 
also a time-consuming process. Moreover, it limits access to the total range 
of media, and not incidentally, it is a process that is extremely expensive to 
the producer (and the. cost, of course, is added to the price of the product). 
Local previewing is an inefficient selection method, since to do it right one 
must be familiar with the total range of materials available', which most media 
personnel axe not. In addition, those who do the selecting ought to have had 
•prior evaluative experience and training, which for most library/media personnel 
tends now to be less than adequate. 

A Promising Practice 

^Here I should like to introduce a brief case report of a promising practice 
that may be of use to others who are facfed with problems similar to those just 
discussed. Eight years ago, a group of building and district librarians in the 
San Francisco Bay atfea developed a new and practicarapproach to the local media 
reviewing process. We applied what we knew. about book reviewing to the reviewing 
of nonprint media, and came up with a cooperative and workable procedure. With 
each of us doing a thorough evaluation of one, two, br three items each month, . 
then sharing our efforts at monthly meetings, we obtain a working, hands-on 
knowledge of for more new materials than would have been possible had we con- 
tinued to work alone. Besides this evaluative experience with newer media, each 
of us is now building up our general knowledge, developing an expertise in the 
total range of media, and learning much more about the process of evaluation 
itself. Our printed reviews have turned out to be invaluable reference resources 
not only as printed reviews, but as reminders of what we physically saw and 
heard. / 

'' \ ■ v • 

I believe that, 'were this concept of cooperative media evaluation to be 
introduced and used much more widely than it is, we would see dramatic improve- 
ment in the quality of nonprint media collections. Cooperative evaluation helps 
solve several problems: It gives the library/media specialist a hands-on know- 
ledge of more materials than he or she could review alofie; it saves time by 
dividing the work; it provides an experience that can be trusted as one works 
cooperatively with capable peers; provides greater exposure with less pre- 
viewing cost for media producers to whom it also gives useful feedback about 
products, thus encouraging product improvement in the process. We do it with' 
books, why not with nonprint media? ! 

v 

What Do We Need to Do? 

What do I see after eight years) of intensive work in media evaluation? 
What (to i -we need to do the job betten? First, I believe that we need local access 
to mo^ comprehensive data about the nonprint media we consider for purchase or 
use, the computerized data bank envisioned by some participants in this seminar 
may well be the ultimate answer, By^t until we achieve that visionary develop- 
ment, we ought to improve- existing ?dh%l resources that are more within our 
reach, ' 

For another thing, we desperately need improved bibliographic tools that 
we can -afford to buy. The NICEM indexes have greatly increased their compre- 
hensiveness since the earlier editions, but they still lack the authority to 
which librarians are accustomed. They would be considerably more useful now had * 
their editors opted to use standard library .subject headings (Sears or Library 
of Congress) instead of their rather awkward, too-broad catchword subjects. 
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If we are to work toward the eventual "establishment of a multipurpose 
•qualitative as well as technical data bank system to assist with the selection 
of all kinds of media, we must also develop^and use mtKre rigorously defined 
Evaluative criteria. Perhaps what is needed is a whole new approach to evalua- 
tion, and more attention to iftstructional design of the media we consider than 
we give at the present time. ..^ 

The building library/me&ia specialist needs more ongoing, up-to-date ± 
evaluation/selection tools al<#ng the lines of the Elementary ^School Librcpy 
Collection. One-shot publications that appear one month and are never updated 
are limited in their usefulness. They are quickly outdated in* the rush of new 
productions. Comprehensive evaluative media selection tools are notably lacking 

at the secondary level; there^ren't any. 

\~ 

Finally we should recogftlze that producers' catalogs are still one of 
our most useful (and accessible) evaluation/selection tools. But they need 
improvement, too, especially with respect to such simple and obvious things as 
providing comprehensive and accurate descriptive data and alphabetical indexes. 
Perhaps the most important information that should be provided in producers' 
catalogs is the reporting of tr^out and revision activities that are undertaken 
during the formative* stages oi ■% product to improve its impact. 

Institutions now exist through which these and other needed changes could 
be achieved--NICEM, ERIC, EPIE, <AECT, ALA, Library of Congress, Association of 
Media Producers, Association of American Publishers, and others. How do we get 
the effort organized? } ' 
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A PROCESS FOR PROVIDING INFORMATION TO PROSPECTIVE 
USERS FOR. THE SELECTION^ INSTRUCTIONAL MATERIALS 

Robert C. Gerletti, Director 
Educational Media Services 
Los Angeles County Schools 
Downey, California 

The output in this country of instructional materials of x all kinds is 
significant, and it continues to increase. . In contemplating the phenomenon- of 
growth in quantity of nonprint materials, in particular, and in attempting to 
work with it, several general concerns have developed. 

Concerns About Media Selection v 

The principal concerns of those involved with the selection of nonprint 
instructional materials range from the cost of carrying out that activity to 
the need to guarantee that wtyat is finally purchased will turn out to be worth 
the money spent on it— from the viewpoint of '^educational returns V They may 
be summarized as follows: 

* The cost of previewing is great. Despite this fact, however, 
the amount of previewing that is 'carried on continues to grow. 

0 Thfs may be due, in part, to the very quantity of new nonprint \ 
media and to their sophistication (a verbal description, may not \ 
be believed to describe adequately a visual production, for 
example). But probably it is due more to the fact that people 
feel "we must do it our way,." Are there ways to reduce preview ■ 
costs and still obtain reliable.results in selection? 

* New demands by some legislatures relative to legal compliances 

in areas such as minorities and sexism often add significantly to 
time and cost requirements to carry out selection. In some cases, 
lawyers are being employed to help screen materials* Does this 
mean that things^af^ going too far? >■ "'.'.'.' 

* Roles of local boards of education with, respect to selection are 
changing; they must often approve and ladopt* What confidence can 
such groups have in the selection ptbcess used to propose materials 
for such purposes? 

In times "of declining enrollment, shifting priorities, energy 
crisis, and other phenomena which affect the use and limitations 
on tax dollars, how do we stretch what we have? Do. We create 
consortia through which to share, and thus spread, costs of educa- 
tional media? Do we buy those material^ whose costs ate lowest? 
Has th^ time come when we should question "certain age-old standards" 
like "ten of these" (whatever) for each pupil as proper instructional 
management? * 

How can we improve our selection criteria and the procedures through 
which we apply them? Can we afford the luxury^ of fuzzy criteria? 
Should we pay film prices for the* presentation' of content that should 
be iii sound filmstrip form, for example? 

.. 21" • 



* How can we reduce the cost of fc doing business? Decentralizing 

, - decisions with respect to mddia selection, for example, increases . 
costs. (It may also put sellectiQip in the hands of individuals 
who are relatively inexperienced With the process and whose 
acquaintance with the full range of available media is quite 
\ limited.) Many producers arfe dropping distributors. Instead, 
they employ salesmen to go directly to individual schools, which 
may itself be a costly procedure, ^ 

* How can we collect dependable! fa'iets about learning/ and learning 
efficiency, especially with rlpgajrd to contributions of media, 
and organize them into usable operational procedures that can be 
applied directly in instruction?* 

* Is it about time that we reassess readability formulas? Some 
people are known to use formulas that were developed in the 1930s 
and early 1940s. But should they? Are their formulas now out-of- 
date and thus invalid for today's sophisticated students? 
(Occasiqnally we also find that readability formulas are being used 
in Judging audio Materials, which seems a waste of time!) 

* Can we make better* utilization than we do of information we have 
concerning listening in the design, production, selection, and use 
of audio materials? 

* Should there be more participation than there is by the general 
public in the, selection of school media? Should this process be 
more systematized and more publicized than it now is? 

Information Needefr^for the Selection Process 

It is apparent that individuals involved in selecting instructional 
media require as much good, specific information as they can get --quickly and 
conveniently. The following needs are regarded as paramount for the purpose: 

* Accurate producer information about products developed for the 
educational market. This information should bh supplied to some 
central sources (such as the Library of Congress jANI^EM, or EPIE) 
as soon as possible. At the earliest stage, the ^fprmatidn . 
supplied would be principally bibliographic, but it might also in- 
clude the item purposes and data derived from already-completed 
formative studies undertaken by the producer to guide the design of 
the product. (Of course, editing of such statements may be ex- 
pected to be necessary to keep them "factual,") 

* Reports of field analyses (to be performed, insofar as possible, 
by qualified individuals in state, regional, county,- and perhaps 
school district offices) which include: assessments. of the tech- 
nical quality of items; additional bibliographic data not furnished 
originally by the producer; comparisons of the new items with those 
already existing in the curriculum field; an EPIE-type analysis 
stating (a) item objectives; Cb) the methodology of use called for; 
(c) item content description; (d) description of any evaluation 
process necessary to the use, of the material; (e) noting of biases 
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(sex, ethnicity), if any; (f) assumptions implied regarding the 
world of work; (g), analysis of stated or implied values; and 
(h) quality 6f the ^tern's packaging. * 

Teacher analyses and use data. Information supplied to the com- 
puter should include reactions of teachers gathered through thg use 
of simple for^s designed fqr the purpose. Special attention sjiould 
be given in them to the clarification of exactly what is meant by 
such ratings ais "poor," "fair," "good," "excellent," and the like. 
Room should be (left ^for free comments. e 

Student reactions. Tttese might be chiefly reports of the demon- 
strated r^sultsl (and effects) of classroom use of the item. 
Reactions might Ibe gathered through use of forms, audio recording, 
teacher observations, parent reactions, or other appropriate means. 
They would, of cpurse, need to be summarized in some useful form 
to be of v^ue ti> others contemplating possible adoption or use 
of the item. \- 

Reports of formal, evaluation studies of the item, if available. 
An instructional evaluation model suitable for this purpose would 
ideally include: la) identification of/fieed for the item; <b) 
statement of the curriculum program goals for which the item is 
ixjtended to be of iljise; (c) curriculum program content coverage; 
(d) listing of specific objectives the materials are intended to 
meet; (e) description of specific instructional methods/means/ 
sti&fcegies necessary to obtain maximum benefit from using the 
item (as obtained from recommendations *of producers and/or reviewers; 
and (f) suggestions regarding future revisions for th,e item. 

A workable, economically efficient information collection/dissemina- 
tion system. This wpuld require the designation and financial support 
of a central unit to gather the information previously mentioned, to 
process it according to plan, to store it in a computer, and to pro- 
gram the means of retrieving and making it available to interested 
users-. 
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THE? BOOKLIST AND ACCESS TO NONPRINT DATA, 

Irene Wood, Nonprint Reviews Editor 

Booklist - 

American Library Association 
Chicago, Illinois " : 

From its beginnings in 1969 ^the Booklist nonprint reviewing program of 
the American Library Association has had as its purpose the publication of 
selected evaluative, critical reviews of recommended current nonprint materials, 
for school and public libraries, as well as of cqiqrtete and accurate technical 
bibliographic data for eadh reviewed item. It i$ f §f course , the second goal . 
that concerns us mogt at this colloquium. Irt this presentation will 
note what Booklist now does to assist media specialists to retrieve and claissify 
nonprint data. In doing 'this, we will alsc^ note technical fata Booklist eon* 
tributes, and the situations and conditions that af feet Booklist r s abi£ ity to . 
provide that information. K 

Indexing and Cataloging 

^Currently Booklist indexes every nonprint item reviewed in its media 
columns. Having always indexed 16mm £}l£b' filmstrips (previously all indi- 
vidual strips in a set, but now just filmstrip sets), and phonodisc recordings , 
the journal has* since September 1975, indexed videocassettes, multimedia kits, 
slices, recordings (cassette), and traveling educational exhibits *as well. The 
only exception is in the case of such lists as Women on Him, which appeared 
in the January 1, 1976 issue. These are indexed in the semi-annual and annual 
•cumulative indexes under "bibliographies. " Individual titles within lists are 
not indexed, 

In-house cataloging, providing appropriate Dewey Decimal System classifica- 
tion numbers, and Library of Congress subject headings , is given for 16mm films , 
filmstrip sets, and phonodisc recordings reviewed in Booklist. In addition, 
Library of Congress card numbers are given for films, filmstrips v phonodisc 
recordings, and slides. / '« , 

Technical Data Provided 

On a purely practical basis, Booklist offers elementary bibliographic data 
about each item it reviews. This minor contribution to a data base includes 
titles, producer (if different from distributor), distributor and address, year 
of production, and year of release (indifferent from production)* Data on 
format (for example* three filmstrips and two accompanying cassettes , • or the con- 
tents of a multimedia kit) necessarily vary with each medium, but indicate \ 
running time in minutes (or frames for filmstrips); Sales price, rental price 
for 16mm film> availability .in other formats, and order numbers complete the 
imprint information for each title* - 

Problems Faced 

Numbers of problems are faced by Booklist in its effort to develop dependable 
nonprint media reviews * Inaccurate or contradictory information is of prime con^ 
cern as a significant but elusive barrier to reliable Booklist imprints* 




Because? , in many cases, Booklist imprints are used by the Library of Congress 
to assign card numbers, our presentation of accurate data is especially impor- 
tant. But the following examples illustrate some concrete difficulties we 
encounter in attempting to do this. As one example, one 16mm film we were to 
review had three titles attributed to it--one on the press release, another on 
the film can label,, and the third on the film itself. There is a not uncommon 
practice, also, of noting varying running times for sound filmstrips--an 
accompanying phonodisc may state that the running time is 12' and a fraction 
minutes while the teacher's guide may give it as 13 or "approximately 13 
minutes. " In such cases, jone follows the rule of the trade and takes the in- 
formation from the medium itself rather than from accompanying information. 
But what about the distributor who lists no running time on a recoydirtg, but 
gives the tiqie only in a press release or teacher guide? How accurate are 
these for ordering, cataloging, or, in an optional state, inputting data in a - 
nonprint Information network retrieval system? ^ 

\ Another hindrance to our offering complete bibliographic data is the lack 
of full coverage provided by the Library of Congress in its own catalog cayd 
program. ^The LC cataloging division, nonprint users, anil the Booklist editprial 
staff ail see the need for the availability of LC cards for such formats as 
audiotape cassettes, multimedia kits, and videocassettes. But because of lack 
of funding, such coverage is not now provided. 

Still another kind of problem we face stems from an unavoidable time lag 
between the time a nonprint media item is submitted for review and the time of 
publication of the review. In "the interval, prices may change. To avoid 
printing inaccurate price data, we have lately '"begun to double-check this and 
other technical information just ahead of the printing deadline. * 

Another \>f our problems derives from the fact that we need more hands and 
minds to do the work we have to do. Currently, all Booklist classification, 
indexing, and cataloging are'done by a part-t-yne staff cataloger. Although the 
work of this. individual for the book section has been lessened by recent intro- 
duction of the Ohio College Library Center (OCLC) computer service and in- 
stallation of an on-line terminal in the Booklist office, we still await intro- 
duction of nonprint titles into the OCLC system. Depending <m which formats 
OCLC finally includes, such data is expected to provide greater standardization 
of and improved access to such information; it will also permit us to provide 
more comprehensive cataloging information for media formats that we do not now 
cover (multimedia kits and slides, for example). 

Outlook 

Perhaps the foregoing examples presented from the perspective of a reviewing 
journal serving both the distributor and the consumer may serve to illustrate 
facets of both the problems and the potential of a computer-based nonprint data 
base and network system. It is our conclusion that such a system is needed and 
that it is not an impossible task. As a beginning toward accomplishing this, 
nonprint producers and distributors must be impressed with the need to identify 
and present accurate, standardized technical d^ta for t^fiirmaterfkls. Consumers 
and users must be motivated to demand such accuracy and completeness in data, and 
thus help convince distributors that such information is vital to the identifica- 
tion, acquisition, and retrieval of information about the enormous amount of 
media with which we must deal. 

By participating in ongoing, problemrsolving conferences such as this, and 

~ *>>. 
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by voicing the particular needs /each of us has, perhaps the producers and 
distributors, the buyers and usfers, and those who bridge the. information gap 
in between— the librarians, -media specialists, evaluators, and indexers—will 
eventually aid the development of a comprehensive, current, and reliable data 
base-network from which all of us will profit. 
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III. VIEWPOINTS: ; 
U.$» GOVERNMENT GROUP 



The present media management and media information activities of 
four U.S. 'Government or government -funded agencies were discussed by the 
second group of seminar contributors . 
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NATIONAL AUDIOVISUAL CENTER INFORMATION SERVICES: . 
AN- OVERVIEW . . V. / '} 

Jean MeCauley, Chief . • „ ' 
Information Branch 

National Audiovisual Center , ^ — -\ 

Washington, B.C. J . N 

• ■ • . ■ ■ ' - ' t 

The National Audiovisual Center (NAG), an organisation within^ the 
federal government, was established in July 1969 as the central distributor 
and information source for U.S. government -produced audiovisual material^ 
As such, it is a clearinghouse for information about and a central sales, ] 
rental, and free loan distribution point for government-produced audiovisual 
materials. In addition, it aids federal agencies in matters related to the 
production and distribution of their own audiovisual products* 

* 

Description of NAC Services . * » ■ 

NAC provides program support for sales of all types of media, including 
8w and 16mm films, audiotapes/ videotapes, slides, filmstrips* and others. 
At present, only 16mm films are rented ftfom this source. It has recently, been * 
determined that free loan requests for films could be serviced better through 
commercial distributors and th^t NAC f s chief contribution in this activity 
ought to be simply to maintain records of the; placement and circulation of 
films placed in such service. v 

NAC 1 s automate^ computer records system consists of three major computer 
tape files: (1) an inventory of NAC audiovisual media, with identification 
data of the federal agencies which have deposited them; (2) a file of media 
titles and catalog information (the "Master Data R.le H ) for 110 federal agencies 
that is capable of producing formatted printquts for use as search tools by the 
staff; and (3) an historic file containing titles of all "items that have been 
recorded by NAC--which serves a number of purposes such as ^identifying dupli- 
cated titles or title numbers, controlling information required for computerized 
statistical reports dealing with loans, previews, and/or sales, and rentals of / 
NAC products over certain time periods* 

Rev ised NAC Missions \ 

A recent report prepared at the request of the Off ice . of Management and 
Budget recommended that NAC "establish a common data base, and develop a common 

"indexing scheme, for all government audiovisual pr^ucts which are available 
either to the public or to the government at large?* the same time that 
report was being written, NAC itself was conducting an in-ftouse study of its 
own requirements for automatic data ^processing support of inventory, booking, 
and order-processing items for its collection. The common data base now* called 
for requires that information abputc=all federally-produced audiovisual materials 
be maintained by NAC, rather than only audiovisuals selected for marketing 
purposes, as was the previous practice* While this mandate will place an addi- 
tional work load on the MAC* staff, it will provide a useful source of data 

* about government audiovisual media that is needed in the field. The fact that 
agencies will be expected* to report contemplated or pre-completed production of 
audiovisuals will 4 help ^prevent/duplication* These same agencies will be ex- 
pected to search the I^KC^data base before -launching into a new film production. 
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luiovmtipn obtained from the NAC search will include contact names in other 
agencies /in the process of filming the same or related subject (s) . The system 
should also /reduce unnecessary duplication o£ records concerning the scope and 
volune of federal publications/ • 5 / 



Possibl/e NAC Contributions of Evaluative Review s 

/ — 1 . " 1 1 1 ' ) — — 1 

Ijt is expected that NAC's principal contributions o£ evaluative media 
data w|Ul cooe through reviews of materials made by subject experts and educators. 
The present film cataloging , system depends upon the agencies that produced ^he 
item for content descriptions and other review data. This often results in) 
minimal attention to abstracting techniques and to the use of indexing terminology 
common to other branches of the information field'. Future refinement and im- 
provement of these processes is anticipated. At that time, it may* be expected 
that greater attention will be given to product purposes, target audience 
characteristics and needs, and economic ramifications for quality evaluations. % 

An alternative to developing a system to produce qualitative evaluative 
reviews of NAC products Gould be to expand user-purchaser preview services pro- 
vided by mail. But this method would involve inventory, scheduling, and storage 
considerations and would probably be quite expensive and unfeasible to carry- out. 

It , cannot be expected that NAC will be capable of producing immediately any 
large numbers of evaluative review^ of government media. Organizing and collating, 
product data reported by various agencies into an information system are some of 
the Center's prioritized activities, as well as thfe maintenance and distribution 
of these materials and their necessary transaction records* However, the new 
data management system now being designed will utilize the present .operating pro- 
cedures and at the same time will provide capabilities for meeting future re- 
quirements. One of these considerations will be the much-needed qualitative 
review services of the type being discussed and recommended at this seminar. 
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AVUNEt A CQMPUTERFMANAGED REFERENCE FIU3*0F SELECTED - 
EDUCATIONAL , MATERIALS IN THE HEALTH SC IENCES 

Charles NwFarmer* Jr. 

National Me'diqart Audiovisual Center 

National Libra^ of Medicine . . , 

^Atlanta, Georgia y 

With the creation o£ new medical and flental schools in the late sixties 
and early seventies, new and advanced trends in education emerged/ centered 
around individtialigation of curricula and multi-track approaches t& education* 
These trends, ^oupled with the*need to increase enrollment and manage explosion 
of new knowledge in the fiel^ convinced many educators thiit the traditional 
textbook ecture approach would have to be altered and supplemented* One 
approach to the solution of this problem has been the creation of a large body 
of audiovisual support an&programmed learning materials, The volume of such 
» instructional material hasNbecome so large and cumbersome^ as to /be unmanageable. 

In 1968, collaboration was begun between the National Library of Medicine 
(NLM) and the Association of, American Medical* Colleges (AAMC) to explore ways 
in which the academic medical community might assist in planning information 
services to be provided by NLM. A significant result of these efforts was the 
realisation of a longtime goa^t of the Library— : the development Of a cleaudng- 
house of information on nonprint instructional materials in the health sciences. 
The clearinghouse is located at the Library's National Medical Audiovisual 
Center in Atlanta, A - 

AVLINE: How It Works V 

The objectives of the clearinghouse, are to develop and maintain a system 
of bibliographic control for high quality nonprint educational materials and 
to inform health science educators of their availability. An important com- 
ponent of- this system, known as AVLINE (#udiovisual$ On-Line), is a Remotely J 
accessible computer-managed reference file tfiat provides information about 
instructional materials that fulfill requirements specified by the user. 
Using MEDLINE (Medical Literature Analysis and Retrieval System-Qn-Line) tea^ 
minals, a person is able to make a rapid search ok recommended audiovisual \ L 
educational materials in the health sciences. TTie information in AVLINE \i 
accessible to the MEDLINE network and other use^s, as well as for the prepara- 
tion of catalogs an<i special listings. The system also provides information 
to enable teachers to determine subject areas And conc^jfts for which no 
acceptable teaching materials are available. 




Steps in the AVLINE process include: 

L 7 

Identifying materials fot inclusion in the system. 
Appraising the materials.,^ j'i 
Organizing the information. / 

Distributing the information. \ ° 

Evaluating the system. ■/ ■ * 

To identify newer materials, the AAMC Division of Educational Resources, 
in conjunction with the American Association of Dental Schools (AADS), initiated 
the Health Educational Materials Inventory. Survey forms were circulated to 
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obtain a list of materials being used in teaching programs, available for use 
by other schools, and available for review. The forms are received and pro- 
cessed by AAMC Atlanta staff and copies sent to the National Medical Audio- 
visual Center (NMAC) . Descriptive information for each title identified is 
entered into the data base from which lists of materials can be selectedxfor 
review. A variety of media formats are included, such as motion pictures," 
television tapes, slides, filmstrips, and audiotapes. 

Appraising AVLINE Materials 

/TFk* appraisal step, particularly that point at which AAMC review panelists 
assign a rating, is critical. Items "not recommended" will not progress in the 
system. The review includes appraisal by an educational design specialist, a 
media specialist, and usually four content experts nominated by constituent 
societies of AAMC or AADS. The review process, depending on the number and 
complexity of the materials, usually requires at least two days. Eaclrpanelist 
individually rates each title. All titles are appraised and rated on content 
validity, instructional design, and technical quality. The scale of ratings in- 
cludes "highly recommended," "recommended," and "not recommended." An important 
aspect of the material is its teaching effectiveness. Plans are being developed 
to devise a mechanism for reporting such information. 

After the materials are appraised by the review panel, information on the 
recommended titles is validated' by NMAC staff to insure that descriptive infor- 
mation is accurate. NLM completes the information development by assigning 
subject headings, cataloging, indexing, and abstracting. Complete information 
on each title is then entered into the computer and becomes a part of AVLINE. 

Materials that are "recommended" or "highly recommended" must be available 
nationally if they are to be included in AVLINE. The reSponsbility of the 
Library is to insure that these materials are available through its own re- 
sources, such as the free film or videotape loan programs at NMAC, or from other 
loan or sale sources, including the sales program of the National Audiovisual 
Center, General Services Administration. 

AVLINE makes possible machine-generated searches for use by faculty, 
biomedical communicators, and learning resource centers in academic medical 
centers. Plans call for computer-printed catalogs, but the most useful service 
at present is the rapid search capability providing accurate information on the 
availability of high quality educational materials. 
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THE NATIONAL INSTRUCTIONAL MATERIALS INFORMATION SYSTEM (NIMIS) 

Carl F, Oldsen 
Assistant Director, Information Services u . 

National Center on Educational Media and Materials * 

for the Handicapped ^ . 

Ohio State University 
Columbus, Ohio - ' . * 

The National Instructional Materials Information System (NIMIS) 0 is a 
computer-based, on-line interactive retrieval "system specifically developed to 
assist teachers, parents ,* and other educators in locating information about 
instructional materials in the broad field of special education* It is a project 
of the National Center on Educational Media and Materials for 5 the Handicapped 
(NCEMMH) in conjunction with a number of Area Learning' Resource Centers (ALRC) ? 
and Specialised Offices (SO). Together, these units represent components of 
the Learning Resource Center program of the U.S. Office of Education (USOE) , 
Bureau of Education for the Handicapped. 

Essentials of the NIMIS System 

The NIMIS system has been designed to enable individuals to converse with 
a computer, asking questions and getting immediate answers. Answers are given 
in the form of information that includes bibliographic information and abstracts 
or descriptions of the material. Each NIMIS entry includes, if available, items 
of identification such as the following: author, title, publisher, prifce, and 
abstract/description. * 

Although this information -can bo, obtained through terminals at the National 
Center on an instantaneous basis during the system's hours of operation, access £> 
is not limited to the availability of a nearby terminal. Information in NIMIS 
also will be ayaii&ble in print form* NCEMMH plans to send printed NIMIS 
bibliographies to the ALRCs and SOs„ and to more than 7Q0 local learning resource 
centers to ensure wide dissemination of this useful information. As NIMIS grows, 
periodic updated bibliographies will be prepared." 

/ The first two NIMIS terminals were installed at the National Center during 

' the summer, 1975. Additional terminals will be installed in different sites as 
the volume of requests rises and as the size of the data base increasesv 

The system is moving quickly through the transition stage from "in limited 
operation 11 to "in full operation." In the next year or two, links planned be- 
tween NIMIS and various state and regional library catalog computerized networks 
are expected to make NIMIS even more widely available. This will be effected 
through the Ohio College Library Center (to be discussed later) and Tymshare . 
networks, 

'First Such 0 National System 

In the past, various media information systems have been designed to serve 
persons wprking with handicapped learners. Some of them still remain in limited 
local or regional .operation. Although many df them worked well Independently, 
until now there has been no nationally coordinated system for identif ying>iftat e * 
rials for the handicapped and for the sharing of common Information about them 
across regional and state boundaries.?' However, a significant array of data exists 
concerning their identification, description, source, use*, and technical develop- 



f 



raent. NIMIS represents a, positive step toward obtaining, organising storing, 
and retrieving such information in a useful; cost efficient, accessible manner. 

Materials Included in the NIMIS System 

The NIMIS system has been designed to provide descriptive information about 
instructional media that will be useful to a nationwide audience. The system 
now contains information on two types of materials: 

' Child-use instructional materials— used by the teacher and/or child 
interacting in the process of education, diagnosis, instruction, and 
evaluation. 

Teacher t raining materials — used to train or assist teachers or teachers- 
to-be in the selection, utilization, design, or adaption of media, 
materials, and educational technology (such as how to operate instructional 
equipment or how to make aiid use transparencies). 

Eventually, data regarding two other types of instructional materials will 
be included in the system: 

Measureme nt and evaluation materials— designed for use to evaluate, 
measure, and diagnose the current skills of handicapped children. . 

Prototype materials— experimental or one-of-a-kind items that have 
been developed as models for possible future development. 

When NIMIS is in full operation, it is expected that about three-fourths 
of the entries will be for nonprint materials such as instructional kits, 
teachi^g-machin&S and programs, films, video cassettes, audio cassettes, film- 
strips, games, toys, or transparencies. 

How Materials Get Into NIMIS 

Specialized Offices employ experts in instructional problems who are well 
qualified to examine the thousands of items of media and materials considered 
for the system. These people prepare the information on child-use materials to y 
be included in NIMIS, identifying, classifying, describing, and encoding them, 
and sending them to NCEMMH, where they are entered into the system. 

NCEMMH also coordinates the development of common standards and procedures 
for the SOs and ALRCs to use in identifying and collecting system information 
Every entry submitted by SOs and ALRCs is given a final check for consistent 
and adherence to standards by a NCEMMH technical editor before it is enterel into 
the system. ' r 

Technical Considerations 

. The National Instructional Materials Information System is availably via 
the Ohio College Library Center (OCLC) system, an on-line, shared cataldfing 
network for libraries. Drawing from the individual participating libraipes, 
MARC (Machine Readable Cataloging) records from the Library of CongressI and the 
National Center on Educational Media and Materials for the Handicapped/ the OCLC 
data base currently consists pf over 2 million items. As of this date! the 
National Center has input approximately 6,500 pieces of instructional Material. 

Discussion and Observations 

The NIMIS» requirements of a data base are specific yet many-facfked. It is 
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ultimately important that the base be searchable, that it be an information 
storage and retrieval system. It is equally important that it be possible to 
produce tapes of NIMIS records, since a primary NIMIS goal is to generate indexes 
and bibliographies of materials it holds. Other factors considered in extending 
the range of the NIMIS system were the potential production of microfiche, the 
availability of upper and lower case characters, field and format specifications, 
and circulation control capabilities. With respect to all of these matters, ^ 
OCLC seemed the appropriate choice. 

Other, unanticipated benefits came from this move. OCLC has expanded over 
the past five years to encompass a territory of over 22' states with 1,000 * 
terminals in approximately 500 libraries. Thus NIMI§, too, has achieved an ex- 
posure not possible via a traditional, profit-oriented data base. Any member 
OCLC library has access to NIMIS records; any interested user is as close to 
the NIMIS data base as the nearest participating OCLC library. 

Duplication of effort in the cataloging of these instructional materials 
is also reduced to a minimum with the OCLC arrangement.- The major premise of 
OCLC being the sharing of cataloging records and information, the efforts of any 
library dealing with cataloging instructional materials are lessened with this 
on-line, interactive data base. NIMIS and NIMIS records are no exception. Not 
only does NIMIS get greater exposure through OCLC, it also gets a helping hand. 

But, perhaps, the primary fringe benefit gained from cooperation with the 
OCLC system is the standardized format adopted and adhered to by member libraries. 
Each library enters data on a prescribed work form provided by OCLC which follows 
the MARC format used by the Library of Congress. There are presently two such 
formats: books and audiovisual/special instructional materials, with plans for 
a music and map format in development. By using these standardized and uniform 
formats, NIMIS records are not only compatible w/th Library of Congress records 
but they also conform with the bibliographic data controls and guidelines set by 
major library associations. This extracts from NIMIS materials the complete 
bibliographic information required by library standards and needed by teachers, 
and thus allows NIMIS users to understand NIMIS records with only a rudimentary 
knowledge of library practices. 0 

This is not to say, however, that OCLC does not have its limitations or im- 
perfections. Some inadequacy is merely "the other side of the coin, 11 e.g. stan- 
dardization can be restrictive and tends to diminish customized system develop- 
ment. Other deficiencies are simply idiosyncracies or characteristics of the 
network . , ? 

The greatest share of problems, under the present arrangement, stems from 
the fact that a prominent purpose of OCLC is to produce cards. The on-line 
cataloging affords libraries the opportunity to have car^s printed with their 
own information in their preferred profile. NIMIS is not ultimately concerned 
with these aspects of catalog cards. Primarily, it seeks a systep which will 
accomodate information storage and retrieval needs as well as^the printing of 
various by-products. OCLC meets those requirements suit ably v and benefits NIMIS 
with the extras already discussed. 

Overall, the sacrifices assumed by NIMIS in subscribing to the OCLC ate 
subsumed in the advantages t>f 0C1C over other data bases and existing systems. 
The potential for the dissemination of information in a standard, accepted format 
is one that is not to be taken lightly, particularly in the area of nonprint 
materials information. 
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ntpmmJ Jl +Z ive up-to-date news about the development of NIMIS, write to 
NCEMMH at the address given in the appendix and ask for a complimentary sub- 
SC !t? t u? n ^ the NCEMMH news letter, Apropos. Another helpful publication 
available from NCEMMH is "How to Use NIMIS: The Key to Information abo^ 
Instructional Materials for the Handicapped," a 12*page brochure that describes 
NIMIS. In easy-to-understand terms aimed at teachers rather than librarians, 
iL+t™*,* 65 * follow j n g topics: why special education teachers need NIMIS, 
what handicaps it covers, how it works, what types of materials it includes, 
and how to get answers from NIMIS by asking five key questions. The brochure 
?k? V2? 1 J ° nS th ! In3t ™ ct *™al Materials Thesaurus for Special Education, 
third edition, which lists and explains the more than 800 NIMIS descriptors. 
The brochure contains a representative NIMIS abstract and lists the addresses 
»L 5! J i earnin S. R ?source Centers where NIMIS terminals are to, be located 

and from which further information may be obtained. | 
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NONPRINT MEDIA DATA BASES AT . 

Lenore S. Maruyama - - 

MARC Development Office • ■"' " 

Library of Congress 

Washington, D.C. . ' 

The Library of Congress 'r (LC> collection poHcies in the area of nonprint 
media are geared toward the acquisition of such materials for research purposes. 
On the other hand, its cataloging policies, particularly With respect to film 
and special instructional materials, are intended to provide cataloging records 
for libraries or organizations where the primary emphasis is not ort research or 
archival needs but on requirements for the more general users, e.gv^stujents, 
public library patrons, etc. This dichotomy is partially reflected in the non- 
print media data bases and the machine -readable cataloging (MARC) records 
developed at the Library of Congress. 

MARC Nonprint Media Formats -. _ 4 

» The foll6wi.ng is a list of the MARC formats for "nonprint media that have 
been issued : < * » 

Format Coverage — - Publication Date 

Films ' Film material 1971' 

(Motion pictures, film- 
strips, slides, trans- 
parencies, video- 
recordings) 

Maps Maps 1970 

Music Music scores In press 

Musical and nonmusical 
sound recordings 

(diW^open reel tapes, . • .. " * 

casse«e§, cartridges, 

wire recordings, cylin- . \ 

ders, piano or organ / 
% rolls, sound films) 

Distribution Services 

The following is a list of the distribution services for machine -readable 
records that have been implemented by the Library of Congress;- 
Service Number of records distribute/ Date implemented 

Films * 32,043 1972 

Maps 20,6fi^ 1973 

Music FY 1977 (if funding is 

■ * approved) 

In addition to distributing these machine-readable records on a subscription 
basis, the Library of Congress uses them to produce printed cards /or maps and 
films and book -catalogs (at this time, only Films md Other ******* f°*J*f f r 
Hon is produced from MARC records) , "and for other aspects of technical processing 
Sntrol, We are also able to producl specialized listings on demand, such as. a 



printojut in card form of Revolutionary War maps of Massachusetts, thr0ftgh the 
use of a retrieval program. ' ~ ^ 

The distribution services and the development of machine-readafol^:t[ecord 
formats are natural progressions of long-standing LC services, such as tne 
distribution of cataloging copy or the work in standardizing cataloging Jrules. 
The advent of the MARC^record itself, however, heralded a new era in biblio- 
graphic control because its design had to accomodate descriptions of afll types 
of materials and be sufficiently flexible to be( u^ed as the basis for automating 
all kinds of library activities in a wide range of libraries jand institutions. 
For these reasons, MARC records distributed by the Library of Congress are rich 
in detail,, not only in terjms of bibliographic content but also in terms of ex- 
plicit identification of* elements in the record to facilitate machine manipulatioi 
of these records. t 

Effects of MARC Services 

In general, the dissemination of machine-readable records has. had a pro- 
found effect in the area of technical processing for outside libraries. Through 
on-line networks and /or commercial vendors, they are now able to obtain cataloging 
copy and other products (such as spine labels or book pockets) much more quickly 
and efficieptly than formerly. The automation of acquisitions and circulation 
functions has also been affected by the existence of these machine -readable 
records. So far, however, relatively little has been done by outside users in 
manipulating the detailed MARC record to produce specialized listings for 
reference functions. Since automated bibliographic control is essential before 
the retrieval function can be performed, most library users have chosen to im- 
plement the bibliographic control function first." 

It should be noted that the existence of machine-readable records for film 
material has had very little impact on the outside user \community except for the 
fact that the Library of Congress is able to produce its printed products (cards 
or book catalogs) more quickly and efficiently. Of the existing on-line library 
networks, only the Washington State Library ^network. has the capability to input 
and process records for film material. The Ohio College Library Center is in 
the process of adding this capability. The users of film material appear to be 
unaware of the advances made because of the existence of MARC records, so that 
improvement of user access would entail more of an education process in the ad- 
vances in technical processing brought about by the library networks such as the 
Washington Library Network, the Ohio College Library clhter network, or BALLOTS 
> (operating from Stanford University) . 

» 
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INFORMATION ORGANIZATIONS 
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Four individuals were invited to represent, entrepreneurial information 
groups. William J. Speed was represented by 3X1 associate at the seminar, and 
C. Edward Wall was unable to be present. 
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NATIONAL INFORMATION CENTER FOR EDUCATIONAL MEDIA : 

A BRIEF OVERVIEW > J . v . , 

M. Thomas Risner, Director ' 

National Information Center for , " . 

Educational Media 0«CEM) • « * 

University of Southern California « * V 

Los Angeles, California 

In 1962, the University of Southern California begat to experiment with 
various data processing techniques in an effort to solve some of the problems 
of cataloging and indexing information for nonpriht educational materials , 
especial ly 16mm films , This work subsequently led to the Automated Cataloging 
Project (U.S. Office of Education-funded) involving Computer-generated cataloging 
services for educational film libraries. At the" conclusion of that project* 
there existed n at the University a computerizedvdatexbank of approximately 12,060 
16mm films for which there were main entries an^descriptive information and the 
capability to produce indexes and catalogs from them on an automated basis. < 
Since then, the University of Southern, California has provided the necessary 
funding to continue to develop and expand the data base. In the process, the* 
National Information^eftter for Educational Media (NICEM) was established (1966) . 

The NICEM Mission 0 
• ° ' '.•'..'.■■» • • 

The purposes of the National Information Center for Educational Media are: 

* To continue to 'build a computerized data base through encoding 
» information on nonprint educational media- for all levels pf 

education; ^ 

* To continue doing experimental and developmental work required to ' 
maintain NICEM as a national center for the management and 
dissemination of such information; r \- v- . ■ 

* To develop suitable publishing techniques to facilitate- informa- 
tion dissemination in this aspect of the media field| and 

* To continue to experiment with, refine, and ^provide computerized 
cataloging services for media centers and-libraries. 6 

NICEM Operations • ■''< ' 

NICEM acquires its information from three sources: (1) the Library of 
Congress (LC), (2) media producers arid distributors, and (3) media centers and 
libraries. The integrity of the file is maintained through verification of in- 
formation from the producer/distributor and the Library of Congress. The NICEM 
research and editorial staf£ maintains and consults extensive archival files of 
all documents /dealing, with ratebook educational materials. Criteria to guide the 
formating and [arrangement of data in the data base itself are Standards for '* 
Cataloging Nonprint Materials (AECT) and Anglo-Ameriean Cataloging Rules (MA). 

Library of Congress data input to NICEM is based on an agreement entered - r 
into between it and the University of Southern California under which data 
supplied to LC from other sources will be used jointly by LCMflofr the production 
of library cards and by NICEM for compiling computerized data Aanks for nonbook 



educational materials. Under this arrangement, .producers and/or distributors 
of nonbook media submit data to LC for their^roduction, using a "Master Input; 
Report Form" that assures proper cataloging of titles and subsequeiit encoding 
of information in the NICEM data bank and later publication^ data in, an 
appropriate NICEM index or updated supplement . 

. NICEM data bank input froifi media centers and libraries also helps to 
insure file completeness and accuracy. For example, in providing £ custom 
book catalog service for nonbook materials (i.e. , the automated preparation of 
camera-ready copy from whith local nonbook catalogs may be printed) , it is 
necessary to identify local holdings, An alphabetical title listing is for- 
warded to the catalog customer, who then identifies titles held locally and adds 
unique information (such as call numbers, audience level rating, and rental 
xates) for each item in the collection. NICEM input cards are then prepared for 
each ti$4e not already in the NICEM data bank, many of which represent local or 
regional productions previously unlisted in LC records. ' 1$ 

The NICEM Record V - 

NICEM has now expanded its data bas^ to a current /ile containing nearly 
500,000 main entries, each consisting o£ 1,000 characters of informatiotf: Our 
nonprint media database includes, as of the first quarter, 1976, the following 
numbers of data entries for specific nonprint media/ 

16mm films 1^8,356 : 



. 35ram filmstrips v 73,892 

8mm motion cartridges ' / 36,157 

Videotapes < ' / 2g38 

Audiotapes • / „ 37,940 

Disc recordings / 35,873 

Overhead transparencies ^81,423 

Slides - / 47,380 

Producers and distributors *if6,247 



Total 461,511 

Currently, NICEM publishes 14 indexes (in 20 volumes, for the 1976-1978 
editions) far which the overall length is 18,000 pages of print. NICEM products 
are distributed to educational media centers and libraries scattered throughout 
the United States and the w^rld. In all, nearly 10,000 institutions have pur- 
chased all or portions of ^ur index series. 

This year, NICEM's operations will include work on approximately ^0 custom 
catalog contracts. We hope to place the, entire 500,000-item datai base fan-line, 
using a sophisticated /System first developed for the aerospace industry. We 
will continue to do special searches and analyses, and we also hope to work out 
an interface program for all nonprint materials, i^H*it>r high school level and 
up, in several subject categories to be used by an armed forces group, in tape 
form, in training commands throughout the world. 

Other future activities in which^NICEM is expected to become involved in- ^ 
elude: (a) providing on-line access to the NICEM data bank; (b) providing a 
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complete nonprint data base on microfilm, with different media integrated by 
subject area; (c) providing local institutions with a data base about their 
own nonprint media holdings; (d) offering systems development and computer 
programming services to update and retrieve nonprint information data from 
local computer bases; and (e) providing updated data banks for institutions 
and retrieving such information for them, as requested. 

The- View from NIC EM 

We at NICEM do not foresee the economic viability of properly evaluating 
the 40,000 to 50,000 new nonprint media items that appear each year, nor do we 
anticipate any really significant changes occurring soon regarding techniques 
eh: approaches to producing and distributing them. Unfortunately, we live in 
an era that seems to permit only very little pre-planning in education. The 
vast majority of the planning of nonprint educational media appears to come 
after the fact," i.e., when the media have already been produced. We agree 
'with Leslie J. Briggs andshis associates, who emphasized: "The choice of 
media to be employed in the classroom should take place before the items tmedia] 
are produced^ not af terwards . " We believe the NICEM data bank has a significant 
future role to play to remedy this situation. 
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MEDIAFILB: A FUNCTIONING NONPRINT 
DATA BASE OPERATION 

William J. 'Speed 
METAFILE 

Audiovisual Associates, Inc. 
Pasadena, California 



MEDIAFILB offers as a nonprint media information system most of the 
services implied in the question which this seminar addresses* Currently, it: 
(1) obtains specific data about nonprint media items* and abstracts $ catalogs, 
collates, and assigns it? (2) stores that data, using a sophisticated computer ' 
system; and (3) retrieves it selectively, employing combinations of tags, in- 
dicators, subfields, and fixed character sets that provide evaluative data 
(reviews, citations in utilization articles, papers, and similar sources) as 
well as descriptive data (from MARC records and other sources, using AECT/MARC 
tagging structure, pricing information, and AECT medium designators) ♦ 

The MEDIAFILB Approach 

MEDIAFILB was begun and is operated by working librarians, educators, and 
media professionals. This has inspired the particular approach taken by its 
parent firm, Audio-Visual Associates (AVA) of Pasadena, California* 

MEDIAFILE started in 1968 because Audio-Visual Associates was not able to 
quickly and economically, locate complete bibliographic and evaluative data on 
audiovisual resources. At least ttyo existing data bases were available to AVA 
when it began operations, but a systematic analysis highlighted several problems 
inherent in using them: (1) item annotations were inadequate; (2) pricing in- 
formation for purchase, lease/hire, ht rental was not included; (3) subject 
headings were oriented towards scholarly research and not working librarians, 
teachers, or ordinary media users; and (4) neither source would provide camera- 
ready copy nor were automated interface options such as magnetic » tape available. 
Hearing of no plans for change by thebe or other sources, AVA thus began building 
its own file of more complete, more usuable bibliographic and descriptive non- 
print media records. * 

MEDIAFILE now has a data base of approximately 500,000 records, more than 
20% of which are in machine readable format based on the AECT/MARC record 
structure! New records are selectively converted to machine readable form at 
the rate of some 20,00b per year. Converting and storing machine readable data 
that is seldom used is the bane of £ll data bases* Therefore, ' AVA* s editorial 
staff has a firm program that weights all new records by format, subject, and iA 
basic integrity so as to minimize wasted conversitan/storage. factors of data base 
construction. Records placed in the machine readable data base are regularly 
' modified to reflect the latest, most accurate information. \ ' 

MEDIAFILE has been used to create three commercial publications: m The Film 
. Review Index* The Media Literature Indeq* and Tiie International Index to Mu&H* 
Media Information* Over 8,000 volumes di: The: Film Review Index and IJulii-tfedia 
Information have been purchased to date. The R.R. Bowfcer Company now market^ a 
1970-72 compilation of The Film Review Index and a second three-year compilation 
of it is nearing completion. An on-line search service for the nonprint media 
field is expected to be launched later this year. * 
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NEDIAPILB can also b© used to generate holdings catalogs, or select media 
graphies for educational institutions, libraries, government agencies, and 
business/industrial concerns. Currently, for example, we are developing just- 
such a mediagraphy entirely in Spanish (citing only resources available in the 
Spanish language) for another country's use. AVA can produce such products in 
hardcopy or microform or in magnetic tape formated for phototypesetting or 
computer-produced microfilm applications. 

Needed Chang es . 

n ^ 

MEDIAFILE sees several important changes necessary to improve the quality 
c-f evaluative and bibliographic data for use by the educational/library 
.ommunity and its users : 
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MARC should be encouraged and funded to expand both in terras of 
quantity and media cataloged. 

Reviewing sources should be encouraged to include more bibliographic 
data with their reviews. 

Software producers and distributors should also be encouraged to 
offer more bibliographic data in their catalogs, including accurate 
production and release dates. 

Everyone should get serious about "suggested audience leuels" cita- 
tions. Distributors who cite prenatal to afterlife applications for 
their products, ahd reviewers who only slightly tighten up such 
claims, need to exercise more care* 

More information on what is needed, rather than simply on what is 
available, is essential to eliminate the follow-the-leader cycle so 
often seen. "Ecology", "metrics", and "women" are three examples. 

Systematic union catalogs of networks should be developed in order 
to expand the availability of shared resources and to reduce agency 
co$ts for producing complete catalogs. o 
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EPIE INSTITUTE'S APPROACH TO THE. . - ' 

KONPRINT MATERIALS INFORMATION PROBLEM s - I 

P. Kenneth Rocoski, President «~ . , ' . - 

Educational Products Information Exchange (EPIE) Institute 

York, New York £> v * * 

EPIE Institute (the Educational Products Information Exchange Institute) 
is a nonprofit, consumer-supported organisation that is involved primarily in 
assessing educational pedia -software and hardware products. It prepares numbers 
of in-depth reports for its members, covering such topics as overhead projector^ > 
bilingual media resources, textbooks, individualised instruction systems, kits * 
for early learning, new reading sykteas, career education materials, and many 
others. m . \ • ■ *' ' ' ■ 

The Nature of the Problem . 

With respect to the matter of nonpr in t educational media evaluation, which 
is the topic of this seminar, we should remember that it is only one part 
(actually the smaller part) of a much larger problem: The need to improve the 
.quality of the teaching/ learning activities that involve almost a quarter of 
t hi s\ country's population for a larg£ portion of their time during , eight months 
of each year in a process known as "instruction." It is the quality of this 
instruction (and of the .learning that results from it) that we ,are trying .to 
improve, and we must maintain this perspective* * 

Twenty- five years ago, perhaps 25,000 instructional materials might have 
been available to the elementary and secondary schools of this country* Today, 
we are nearing 500,000, and we are pressed to cope with the increase. But &ven 
if during the next decade this growth curve were to plateau, as a fcesult of 
conditions under which schools now function, it is unlikely that we would be 
able to cope comprehensively with the quantity problem. It is simply too great 
and too complex to accomplish in its .entirety—on any feasible basis., * 

^Still, because instructional tools of many kinds „ape used so widely to 
structure what goes on in classrooms and what students do to learn, considera- 
tion of ways to improve them are important — perhaps more so than at any other 
time in educational history. 

An EPIE Study: A Possible Solution? 

For the. past two years, EPIE Jjas been involved (with producers, pur- 
chasers, and users of media) in establishing a,data base to focus a? clearly as 
possible on the task of what happens in the hours at school as well as at home 
during which time students use one or another type of instructional material. 
To build this^base, EPIE decided to study £uch activities at the school building 
level and the^tools actually used there to teach reading, mathematics, social 
studies, and science in kindergarten 'through grade twelve. 

We asked building principals and teachers in a stratified, randomly-selected 
sample of the country's 86,400 public school ^buildings— a sample which numbers 
just over 24,000' of that total—what instructional ; materials they currently use, 
the percentage of the time of each instructional period during which various 
categories* of instructional materials are used, and the pattern of that 
utilization (e.g., what percentage of the time is devoted to printed textbooks/ 

< • . ■ ■ ' • £> : If ' « 
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workbooks/other books and what percentage tb.nonbook media, etc.). We .sought 
also to discover how the materials that are used were selected, who selected 
them, where the money came from, and from how many known options they were 
2? "!"«... date, we have answers from teachers and/or principals in just under 
38% of the more, than 24,619 school buildings in our national sample. 

\ ^ ast . s Py in g EPIE also began a series of systematic visits to selected 
schools within our sample to make classroom observations and to perform in- 
t depth interviews with principals, teachers, students, and parents-all related 
to materials -used, how they are used, and how they are perceived, by teachers 
f^o e "i S ' and 1 P a ?" t8 - 1015 spring,, we will gather still more such information 
through a newly formed national network of representative school systems within 
our national sample. This activity will be continued on a regular basis during 
fall and spring 1976-77, and, if things go as planned, in an ongoing pattern 
every year thereafter. This is an expensive undertaking; it is being made 
P ? S *u bl f through the generous support (so far, just under a half million dollars) 
ot the Lilly Endowment (Indianapolis) and with the help of conljributed services 
of scores of educators in local school systems, state agencies, and universities' 
throughout the United States. Add to this the contributed time of teachers and 
principals who fill out questionnaires, willingly participate in interviews ' 
and allow us to observe and to discuss the use of materials in their schools 
with students and parents, and the total size of the effort becomes „ difficult 
to measure in 'dollars -and cents. These cooperating principals and teachers 
are enabling us to examine what materials are actually being used at the school 
building level throughout this country'* and the first mentioned group of educa- 
• 'n£ZZ (l,e *' those from schools, state agencies, and universities) are helping 
EPIE to analyze the instructional design of the materials that, thus far' hale 
been reported as most used in classroom instruction (i.e., textbooks and other 
print-related instructional systems). It is these' materials that teachers tell' 
us they are using to structure about 60% of their students' instructional work 
each day. . " 

While the task of analyzing the instructional design of these primarily 
print -based materials has been enormous, it -has been, and continues, to be 
do-able. What also is proving do-able— although it is more difficult and doHar- 
consuming— is the' gathering of in-depth information on "the use and performance ° 
of the more frequently used print-based .materials. The major reason these tasks 
are do-able, although formidable, is because there are (in the four basic skill 
areas we have studied thus far) some 6,000 titles, two-thirds of which seem to 
receive only marginal classroom use. (I say "seem to receive only marginal use" 
because we still consider our data preliminary, and this picture may change 
somewhat.) , a % , 6 

When we turn to lesser-used materials (i.e., to the nortprint materials 
which are the chief concern of this seminar), the picture is encouraging in one 
respect and less so in another. First 6f all, let me report one finding that 
should be encouraging to advocates of nonprint media. To date, teachers in 
every state, in every size school system, within every level of community from " 
impoverished to affluent, tell EPIE they use nonprint media to carry out 
approximately 35% of their students' instruction each day. This clearly indi- 
cates that these lesser-used materials are not as "lesser used" as some people "~ 
might have supposed. ° 

* if 

However, our findings to date also indicate that the percentage of the 
total nonprint media resources available to teachers and learners in their 
buildings or through district offices that are actually used with any frequency 
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in classroom instruction (or for th^t matter, outside the classroom, as in 
a media center or library) is relatively small. Indeed, it appears that only 
30% of the materials readily available to teachers for classroom use, are 
actually being used in any given year. There are, we think, good reasons for 
this. Some of these reasons we already know; others should become known as we 
expand our in-depth probing. Based on our teacher interviews and questionnaire 
responses, the major factor that seems to control the use of nonprint media in 
instruction is teacher time. This has to do/ first, with the time a teacher 
has, outside of his or her classroom time, in which to become sufficiently 
familiar with nonprint media items to use them with confidence. Secondly, it 
has to do with the time within the classroom that can actually be devoted to 
the use of nonprint media. Given the realities of present-day teaching, will 
the, average teacher (who is telling EPIE that 35% of classroom instruction is 
organized around the use of nonprin| media) be expected to allot more time to 
\ising such media? *: e 0 

When teachers are given the responsibility to structure the learning 
society demands of schools, most of them tend to turn to materials that organize 
that*. task as straightforwardly and as comprehensively as possible. It is not 
surprising, therefore, to f iftd .that the majority of -teachers are organizing 
classroom instruction around the use of programmatic Instructional materials 
such as the print-based .textbook or the kit-based teaching "system.' 1 However, 
it does appear that teachers recognize that such system-based or text-based 
instruction often needs to be relieved by, or to be supported by, uses of 
additional nonprint media. They evidently feel strongly enough about this that 
they are, indeed, using such nonprint media for just over one-third the available 
instructional time they spend with their students. m Butr in drder to use more 
such nonprint media it would be necessary to increase the amount of instructional 
time assigned to them and to reduce the instructional time assigned to print- 
based programs. But to do this teachers would also need to use considerably more 
time outside of the classroom to familiarize themselves with, fl to select, and to 
organize nonprint resources into a coherent and effective instructional program. 
For even though EPIE 1 s analyses of the more widely used print-based programs also 
show many of them to be less than coherent in their instructional design, it is 
simply more realistic (given limited teacher time) for the average teacher to use 
them, rather than nonprint materials,, for most of their instructional time. 
Furthermore, our site visit interviews seem to point to the fact that most non- 
print materials simply do not provide the teacher with the sort of organizational 
support that would justify their use as the major (rather thafi ja supporting) m 
instructional role. 

Qualitative Evaluation: How Much? 

All this reminds us of the question: Is it necessary (or even wise, not 
to mention economically feasible) to attempt to provide in-depth information of 
both a descriptive and qualitative nature for eaQh of the half million or so 
nonprint materials currently cataloged by NICEM? For our part, we believe the 
answer should be M no. tf EPIE feels that the following strategy is sound: We 
should not try to evaluate everything because everything not only isn't being 
used- -everything simply can't be used. Any effort to. evaluate everything is- 
bound to be wasted; it is an impossible goal. Instead, we should concentrate 
on evaluating what teachers and students use— most widely. But of course we 
should a^the same time also keep an eye on the innovative and the more thor- 
>etrgtt5Tresearched materials* that are good but that may not yet be widely used. 
More attention should be given tp process evaluation and to learner verification. 

42 ■ ■ * > 



46 



\ 

We should encourage the plowing back of what is learned about lie quality 
and value of materials into the design of better products ovexfU period of 
time. And we should encourage producers/publishers to use somfe /income derived 
from their products, to revise and improve them-and to help t&ers and students 
to make better use of them-while they are on the market. 1 ? "uaenzs 
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MEDM REVIEW DIGEST: COMPUTER APPLICATIONS 
QUALITATIVE MEDIA INFORMATION 

C. Edward Wall, Head Librarian 

University of Michigan, Dearborn • , 

(Editor, Media Review Digest • , 

Ann Arbor, Michigan) 

f • •• 

media Review Digest (MRD) is designed as a selection, acquisitions; 
cataloging, and reference tool for all- nonprint media. Those of us who have 
been involved with it have encountered numerous problems, as well as opportu- 
nities, in applying computer-related technologyjiad software to input, organize, 

and retrieve the information with which it deals. 

t ■ ' • •, 

it 

Background History 

Media Review Digest was established in 1970 under the title Multi-Media . 
Review Index, at wljich time it performed one function: It indexed reviews of 
educational and entertainment nonprint media. The first volume (1970) covered 
•10,000 reviews from 70 periodicals. This was expanded to 20; 000 reviews from 
130 periodicals for 1971 arid; to 30,000 reviews from 214 sources for 1972. 

In 1973, Media Review Digest' expanded greatly in terms of text content 
and with that increase, split into two volumes ,\pne covering /films, filmstrips, 
and miscellaneous media and the other records and tapes. These two parts each, 
include an annual volume, separately published cumulative subject indexes, and • 
three supplements. Part I is now divided into five elements; Films (which, 
includes both educational and entertainment films in all formats, as well as 
television programs and videotapes), Filmstrips, Miscellaneous Media, Film 
Awards and Prizes, Mediagraphies (consisting of filmographies and other biblio- 
graphies of media, "arranged by subject and describing the contents of each). 
More recently a section on books has also been added. 

Media Review Digest review citations are contributed by media specialists 
and librarians— most from the united States, but a few from foreign countries 
who monitor assigned journals. . They prepare index cards containing the title 
of the item; full review citations, including the reviewer's name, if given; and 
a code indicating the qualitative judgment of the review. A plus (*) stands for 
a favorable review, a minus (-) for a negative review, a plus/minus combination 
(+-) for a mixed review or an average valuation, while an asterisk (*) indicates 
a basically descriptive review. A full-time staff reviews all data, provides . 
original cataloging, and directly indexes certain key journals. 

The following' typical information is provided for each "educational" entry: 
(1) title; ^<2) subtitle; (3) titles in series; (4) series title; (5) producer; 
(6) distributor; (7) date of release; (8) millimeter sizes; (9) running time; 
(10) sound or silent; (11) color or black and white; (12) price (added, in 1975);. 
(13) a description; (14) Library of Congress subject headings; (15) Dewey 
Decimal Classification numbers; (16) a general subject indicator; ' (17) audience 
level; (18) review citations including title of source, volume, issue, date, and 
page, reviewer's name, and the code (described above), and quotations from . 
approximately one-quarter of all the reviews; and (19) award and prize citations. 
For feature films and other media sources, additional appropriate data are also 



provided, such as: (20) film ratings by the U.S. Catholic Conference's Division 
for Film and Broadcasting, the Motion Picture Association of America, PTA 
Magazine (now discontinued), and Parents Magazine; and (21) foreign and/or 
alternative title references. 

c 

During 1973, Media Review Digest covered 40-45,000 review citations, 
quoted from approximately one-quarter of those reviews, apd cataloged roughly 
as many nonprxnt items as did the Library of Congress . (In this respect it 
should be rioted that MRD cataloging is based on reviews and evaluations of the 
media with back-up references to catalogs and brochures, while the Librdry of 
Congress performs its cataloging from data sheets provided by the producers of 
the media. ) 

Application of Data Elements " 

The^bove list of data elements is by no means complete, but it does in- 
clude those most ^frequently employed in producing MRD. They also reflect fields 
of information that are of particular importance to the future development of MRD 
and its derivative publications: Many of these applications will be obvibus, but 
are briefly reviewed here, as follows: 

* Title information (1, 2, 3, 4, 21) is extensively cross-referenced 
within the MRD text, e.g., subtitles to titles, series titles to 
individual titles in the series if they have been evaluated ' 

^ separately and vice-versa, translated titles to original titles, 

etc. These fields of information perform several functions iri 
addition to cro^s -references, such as the identification of entries 
that have been cited under variant titles, that might not otherwise 
have been located and consolidated with the main "cluster" of* reviews. 
% 

* Mediagraphic data (5, 6, 7, 8, 9, 10, 11, 12) is essential to the 
identification of media characteristics, such as currency, 
appropriateness to a budget, application of format to existing 
equipment, and availability. MRD cumulative annual subject indexes 
also include a directory of producers and distributors. Data 
elements 5 and 6 spin off citations for this directory. Eventually 
MRD could also produce another index— one by producer or distributor 
citing their media covered in MRD for each producer and distributor. 

^ It is anticipated that several directories and guides may be produce^ ' 
from the basic data compiled by Mltf). In this respect, a guide may 
limit its coverage to media produced later than a gi vert year (element 

* 7), media in only certain formats, e.g., videotapes or Super 8 loops 
(element 8), media shorter or longer than a certain time (element 9), 4 
only sound media or media in color (elements 10 and 11), or perhaps 

.only media under a certain price (element 12). 

* The description for each educational item occupies a field by itself, . 
This allows its inclusion" or exclusion in any context, as appropriated 
The editors have further anticipated that these descriptions may have 
spin-off applications in the production of film catalogs for individual 
libraries, and other possible uses. With this consideration in mind, 
the length and thoroughness of descriptions is slowly being expanded. 

* Subject indexes (14, 15, and 16) are produced on several levels. 

In the annual cumulative subject indexes for Part I and Part II, three 
. index approaches are now provided* These include a detailed 
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alphabetical subject index based on Library of Congress subject 
headings (element 14), As many such headings are applied to each 
item as hre deemed necessary to retrieve the item now as well as 
- in future spin-off applications. In some cases, this may amount?, « 
to twenty or more headings. 

* Audience level (17) has potential not yet fully developed with 
Media Review Digest. MRD has anticipated producing indexes on a 
current basis that are broken down by audience level ranging from 
PreK to Adult, but these have not yet been implemented* In terms 
of derivative projects., this data element can result in such guideV 

as the "Best New Media for Elementary Education," "Best New Media \^ 
for Secondary Education," and other such publications. 

* Evaluative infbrmation (18, 19, 20) is as critical to the effective 
identification and selection of me^ia as any other" data element in 
the opinion of MRD editors. To this end MRD has attempted to 
record the multiple opinicms from different types of evaluative 
sources, namely: reviews, award and prize citations, and audience 
suitability^ rankings (these latter apply. most frequently to feature 
length films) . 

*;Film ratings (20) have particular importance to feature films, but 
a^so relate to many documentary and otherwise educational^ items. 

Handling Review Data ^ > ^ 

MRD reviews of media are indexed from more than 200 reviewing services. ^ 
Where permission is granted to quote from evaluative reviews, such quotes are 
included as ^impropriate; usually they are limited to 25 words or less. To be 
inc luded , . the quote must add something to understanding of the entry such as 
excellence, audience suitability, availability, etc. 

Reviews are coded (element 18c) to indicate whether or not the item has 
been favorably or otherwise reviewed. MRD. editors recognize the limitations of 
codes such as these, and at one time ^oyed, with A £he idea of a 10-point range, 
or .some other more elaborate scale tllan the one now employed. However, MRD 
adopted a simple four-element scale (+ positive, - negative, *- mixed or 
average, * descriptive) because it seemed to perform the long-range require- 
ments that are desired of this field of information. Through either scanning 
the pages of MRD, or through computer searches, users can identify items that 
have generally (and repeatedly) received good reviews. MRD has adopted a 
similar method of highlighting awards and prizes in format ion --that of assigning 
a "dagger" (t) to each such citation. ^The "dagger" apd "plus" appear very 
similar to the eye and can also be easily located by a computer search to iden- 
tify "outstanding" media. f 

Sources of reviews (element l\8a) and reviewers 1 names (18b) are separate 
fields which will allow MRD to Eventually sort reviews by source, identify who 
has written where (and when), and may provide other derivative future benefits. 

The foregoing has been a basic outline of Media Review Digest—detailing 
its format, types of information covered, fields of infdrmation identified, and 
applications of data to present and future projects. In reality, the context 
of MRD is far more extensive and complex than this discussion reveals; it did 
not touch on records or tapes, for example, or on filmstrips or the complex area 



5 ^ ^ 

46 



known as Miscellaneous Media. All of the groupings offer unique problems and 
have their own potentialities. To really understand the present and derivative 
scope or potential of MRD one must use it to select and order media, to perform 
m-house cataloging, or to handle reference questions about media: In such 
applications, MRO's strengths and weaknesses and needed areas for further 
development will be revealed; and fields of data that need expansion and 



modification will be identified. 
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/ v. viewpoints: 

COMMERCIAL PUBLISHERS 
AND DATA SYSTEM ENTREPRENEURS 



Three representatives of the commercial publishing and/or data system 
entrepreneurial field concluded the presentations at the seminar. Of these, 
David, Biesel of Macmillan Information had been unable to prepare a summary 
paper in advance and so gave his remarks extemporaneously^ They do not appear 
as part of the record. 




R. R, BOWKER COMPANY • S DATA SERVICES 
AND SYSTEMS PROGRAMS 

Andrew H. Uszak 

Vice President 

Data Services* and Systems 

R. R. Bowker Company 

New York, New York 



The Data Services Division of R. R. Bowker is | totally involved in 
computerized data base publishing. Data base publishing, to describe it 
briefly, is the processing of bibliographic data fronuinput to our system 
through final output in the form of composed pages ready for, the printer. 

* . . ■ - . V 

Scope of Services 

Data Services publishes ^monographic and serials indices used by the « 
library, book trade, and publishing marketplace as primary acquisitions/or^ 
dering, reference, and cataloging tools. These publications haire been produced 
to fulfill the needs of the various segments of our marketplace* Establishment 
of these needs has been and will continue to be done through meetings with 
representatives of each segment of the library, book trade, and publishing'world. 
Feedback from customers is important to us in developing- publications and 
services. Customer recommendations and suggestions have frequently, resulted in 
the design and production of entirely new directories" 

Books in Print* Subject Guide to Books in Print* and Books in Print 
Supplement are currently. key products of Data Services. These publications are 
produced from large data bases of over 800,000 monographic and serials titles 
througK^the Bibliographic Information Publications Systems (BIPS), a system^ 
which we developed in t 1970 and to which have been added enhancements to produce 
the many variations included in our directories. ^ Our serials directories—- 
Ulrich's International Periodicals Directory* Irregular Serials 'and Annuals* ° 
and New Serial Titles — are similarJy-irtcxjauced by bur system, as is Subject Guide 
to New Sert&lJ^lee*^tf^^ in the falferof 1975. 

BIPS Capabilities^ and Characteristics 

The Bibliographic Information Publishing System (BIPS) was designed %o 
provide flexibility and capabilities which were not available in the first . 
generation bibliographic system used. The experience of producing directories 
with the first generation system was invaluable and aided in- the development of 
BIPS. Some of the features of the present-day BIPS are as follows: 



Data validation by field; capitalization and punctuation by 
rules of lpgic. 

Parameterized^ selection routines tb extract records from the 
filie by various criteria from fixed coded areas and from various 
data elements. , . , p 

Capability to control transactions not only 1 
by each data field, which ai present can bf 
possible fields per record. | 

Statistical information provided for all t^es of transactions 
by publisher. \ 



by record, but alstf 
a maximum of 192 



* Flexible parameterized routines to extract records required 
for a*current -or future directory and ability to .easily change 
the output format. . ' ' 

* Search extractions to generate up to threjfe output files, each 
different in /ormat, during one computer run, 

* Composition capabilities --through use of PAGECOMP, which was 
developed in conjunction with an cputside service, to typeset 
pages for the output of BIPS and other ^systems/ ^This program 
is flexible and permits the formatting of pages through the use 

of control cards which utilize many standard composition fwictions. 

Each BIPS record is of variable length, containing up to a maximum of 192 
variable length fields. T^iere is a fixed portion to each record? consisting of 
record number, transaction codes, date, and sort key. Each field contains fixed 
information with transaction code, byte count, and date of transaction. This 
permits several groups of editorial personnel to work simultaneously on the* same 
file for different purposes l?y controlling the transaction dates. ^Records are 
updated by field, based on a transaction sequence within date sequence whereby 
the latest date for a particulaij transaction takes precedence. 

The physical file i§ maintained on magnetic tape, 1600 BPI, variable 
blocked format. Record size is 3,000 characters maximum and. generally a physical 
record is equal to a logical record. When composite records are used, a logical* 
record may consist of a maximum of 30 physical records, each containing a maximum 
of 3,000 characters. We currently have access to portions o£ our data base 
through a mini-computer disk system and are exploring the desirability of having 
our data bases totally on-line. • 

Future of BIPS - 

— — .*> ^ 

Portions of BIPS will be utilized in the future to provide audiovisual and 
bibliographic data banks. For example, the Consortium of University Film 
Centers (CUFC) and R. R. Bowker Company are planning to publish a new 16mm 
educational film directory to be known tentatively as the Film Locator. This 
directory will contain a combined list of the more than 30,000 16mm educational 
film titles available from the 43 members of the Consortium. Additionally, it , 
will contain bibliographic, purchase, and rental information .for each title. 
BIPS will be used to produce AV data base and output product?! of the program. 

BIPS also will be utilized to provide data to other systems for various 
purposes. Although the system is not of a general nature, its capabilities for 
bibliographic and similar data are extensive. Only a small percentage of the 
^possible system capabilities has been utilized so far. f . * 




COMPUTER ACCESS TO NONPRINT MEDIA DATA: 
.A POLITICAL* NOT A TECHNICAL PROBLEM - 

C. Walter Stone, President ■ 
J-MARC, Inc. 

Los Angeles, California t ■■ 

* 

Ma 1 X - T S rW ^signsent in 1974 to look into the AIMS (Automated Instructional 
Materials [Handling] System) Project managed by the Los Angeles City Unified 

iSX i22?S C S ACUS ? ) md fUnded by the "' S - ° f£iee of Education! My J£k 
Si? J f ' ® T ° m \ was t0 a PP^ aige results of this pioneering project, one 
goal of which was to develop a system to aid selection of school media by pro- 
ducing a data bank of evaluations (a goal not realized) , P 

The AIMS Project 

„fco<S nCe ^ ed 2 s J^ Tqject < a ' nuinber of X ear s ago and brought to life under the 

oubL^ r t;^ 0f /'^\ dred / r ^ y ' ? ireCt ° r ° f:Sch001 Librari * s for the L°s ^geles 
25 i ♦ • ,* ° ° ther *)» the AIMS idea was to. create an information storage 

T^ltll^Z f ° r L° S ^ elSS that Would utili2e com P^ technology tf 

fStl^^ !i S !- U ° n ' orde y in §' distribution, and effective utilization of all 
instructional media m the city's 900+ schools and special programs. The Systems 
Development Corporation (SDC) of Santa Monica was responsible for major system 
design efforts Representatives of several of the country's largest school 
systems (including New York, Chicago, Detroit, and Philadelphia) served as mem- 
sWer°l^n dvi f or y P^f 1 to "ratify problems, to review results, and.to con- 
sider national implications of the project. The intention was also to develop 
in time a regional service program in cooperation with local school districts 
ities (chiefly southern California) to demonstrate the system's capabil- * 

Eventual jy a full system was conceived and developed in pilot form, but 
not without difficulties (including major reorganizations of both the Los 
tftlll ,17 i Ch °°l Distric * and ° f the SDC ^self, both of which events delayed 
matters and changed responsibilities). For example, some responsibilities of 
SZtSSfS ^^^^d audidvisual service units serving the schools were de- 
S5S2t^L t J"" S 5 lftin ! the locus of medi a selection responsibilities to in- : 
SSfiS teachers rather than continuing them in a central admini- 

strative office. Nonetheless, the system was designed and, in my opinion it 

* ' 

Difficulties of Implementing AIMS • « 

Despite the fact th>AIMS did get designed and seemed at least theoretically 
viable for the purposes intended, it has not "flown^-Why? in my view and 
omitting consideration of the District's own internal, albeit important, problems 
occasioned by proposals for changing operating procedures, We^er^r 9 * 
SsiIne? S ° nS AI ' IS " 0t beconle the ' 'national pilot" effort, original ly^O 

; * First, jthe high posts of computer hardware and operations were more"^" 
than the District could afford, given the recommendations put f orward 
and the existing state of the art. The District budget could not stand 



• the load then suggested for AIMS support ($75Q,D00/year in 1972), 
(Today, such costs would be different; but the system would have 
been modified and introduced in segments.) Also, central units 
could not afford tho staff time needed for proposed evaluation 
activities. ■ 

& Second, a pooled local, regional, or national record of school . 
system evaluations of individual materials (e.g., of given film 
titles) could not be produced and filed, nor would other districts 
(nbr given schools within the Los Angeles District itself) agree 
fully to share such information and/or trust other schools*, eval- 
uation criteria and conclusions regarding nonprint Tafedia** in 
particular. Here* "everybody was an expert," it seemed Cor per- 
haps no one w&s). And as always, with respect to evaluation, 
fear was generated,, usually voiced by production people and 
distributors (and echoed by sonae librarians and audiovisual 
directors), in tqfrms of threatening the continuance of current 
preview privileges or by raising cries against potential "censor- 
, ship" in the. schools. 4 . 0 . 

* Next, raultimedi a correlating, although feasible to accomplish, 
was difficult to obtain (normally, only having been achieved with 
distinction as the consequence of special studies carried forward 
in restricted subject fields, such as those done by EPIE, 'for 
example). i • ' 

* Fourth, the shefcr size or s^ass of the ^ffort required to do the 
job revealed itself to be & serious deterrent. With more than 
90-100,000 16mm non-theatrical films alone to consider (not to 
mention other i|iedia and the fact that/ perhaps S-10,000 new film 
titles which should be evaluated wer<£ being produced annually), 
the job was considered too big for a single district to mount and 
support or evejh for an intrastate region of modest size to do. 
And establishfijent of a cooperative support program for evaluation 
among larger <iity school districts /across the country proved to 
be only a hop^ and without foundation in fact. 

Thus, lacking aj media evaluation component, the AIMS system design was 
completed, paid for,) but not really implemented. It could have greatly ex- 
pedited and improved LACUSD's media acquisition and distribution services. 
But without yielding evaluation data, ttie system would amount to little more 
than an acceleratedjand quite expensiW means of creating and handling fiscal, 
inventory, and shipping records pertaining to school media. The heart of one 
original objective had been excised, qnd interest therefore flagged. 

Is an AIMS System tyeeded? / 

We still need^ but lack, the type of service AIMS might have given in 
California and, perhaps, nationally^* Prerequisite computer systems, much im- 
proved today and far less costly in proportion to capabilities than then, have 
been with us forogome time. But th(e problems of establishing and sharing their 
costs as well as ^heir yield of media evaluation data still remain with us. 

And so, my recommendations aye simple to state, if not to implement. We 
should use and be grateful supporters of the fine work done and which continues 
to be done under the auspices of EFLA, Landers Film Reviews; EPIE/ and th$ 

./ 1 * 
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M?rlS US ™ vl ? win S med^a as well as the invaluable lists of media produced by 
Nice-I and other organizations. But we also should create arrangements requisite 
to making, filing, and sharing access (on whatever basis of confidentiality re- 
quired) to a reservoir of school district -produced evaluations of instructional 
media. And to reduce both present and later costs for updating hardware 
eoaponents, perhaps we should contract through one or more existing computer 
service agencies to provide needed information and clearinghouse-like services 
on some suitable subscription fee basis. Setting up such programs may require 
state-level and/or federal agency endorsement. In California, and in certain 
other states, responsible implementation of the Media Evaluation Law, which re- 
quires evaluation data for all school media adopted, mandates (in my view) the 
creation of such an enterprise. 

In closing, I should like to answer one criticism leveled at the recom- 
mendation just given as voiced by a senior school administrator: ! "There is 
no way," he said, "that we shall ever achieve school media evaluations which 
represent anything more than 'pooled prejudice 1 ." Especially if ihis vere' 
true (which I do not believe), we should have availabl^ for inspection the 
range of -judgments given nationwide by as many informed- school personnel as 
possible augmented by whatever research efforts have been or can be undertaken 
in both the public and private sectors to help with this problem. 
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VI. FINDINGS 



In their face-to-face discussion at the AECT convention, and as a fiesult 
of their later, reactions to points of the papers, the ERIC/XR seminar, partici- 
pants arrived at soae general agreements with regard to the original question. 

Is it possible (and desirable) to develop 
a carnpatible^gnd- economically feasible 
system capable of obtaining, stowing* and 
selectively retrieving dependable qualitative 
(as well as technical or purely descriptive) 
data about specific nonprint items? 

1. The question, as stated, turns out to be three questions: (1) Is 

it technically feasible to do this? (2) Will the field (producers, publishers, 
and users) agree to cooperate in providing input? (3) Will individuals and 
organizations spend the money required to support it? 

2. It is technically possible to develop such a system, using. only 
present technology. As a matter of fact, several such systems already in 
operation, some described in seminar papers, represent useful models. Near- 
future developments in the computer field may be expected to permit extension 
and improvement of present capabilities for this service. 

3. Cooperation among various groups and organizations inputting to the 

new system should extend to such matters as: (a) examining areas of noncoverage 
and duplication of .coverage and, in the latter case, avoiding unnecessary and 
wasteful redundancy; (b) standardizing the format details*of input data records; 
(c) training evaluators and desi^ers of evaluation systems; (d) seeking system 
financial support through grants, subscriptions, support of products sold, or* 
other means; (e) refining standards and procedures, based on research and 
experience, to produce a data bank that is workable*, dependable, and useful; 
(f) weeding and Updating the data bank, as necessary; (g) cooperating with the 
Library of Congress, National Information Center for Educational Media (NICEM), 
and other units; \md (h) highlighting emphases, analyses, products, and services 
In these matters, ^attention should be givetf to capitalizing uppn and inviting 
the continuing participation of individuals and organizations with records of 
prior work and data banks in the field. ~ 

4. Short of a rather dramatic increase in the number of users of such a 
system, it seems doubtful that it could be supported financially at the level 
of similar existing Services. The 2-3,000 basic subscribers to certain of the 
larger cutrent nonpyrnt media information services, for example, would not be 

Sufficient 3 for this purpose. Needed is "consciousness raising" among thousands 
of other potential customers regarding the seriousness of the information 
problem thkt exists ^id the benefits to learning that could be derived from a 
lairger and more comprehensive service. <? 
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5. The compatibility" aspect of the problenr-that is, the need to 
develop computerized data bases that can receive inputs of nonprint media ' 
assessments or evaluations from a variety of sources and in a number of formats 
and, in turn, can exchange data base records with other systems-appears tSta 

SoTS TatinT 2 S ° me r° rdinati ° n ° f SyStem in P UtS ' and'with some^tlndardiL- . 
S Lnf f g / 0rms J md "Poking procedures, coupled with necessary training 

™ EES «p r esenT SmentS ' ^ ^ m ^ ^ 

it on 6 ; Lll e Tl prospec ! for the system's success would be assured by developing 
it on a base that is broader than nonprint media. By including nonprint media 

bility would* hf ea ? y >;? Stab , liShed P""' ^ baSe systems ' for ««-pE"* -pa^ 
ll T* t be . esta " lshed t0 output selective information drawn from as few or 
as many of the input ed sources as desired. The capability of such a system to 
ZrtT l^l multi ™ edia listi "gs of data built from contributions of meaia pro- 
i+tlll' tea f er/st V dent users » research reports, bibliographic reviewers," and 
others would constitute a valuable resource for the field. 

■ 7. To produce effective results and to establish a thoroughly viable non- 
print media evaluative data base systejn will require the cooperative efforts of 
numerous private nonprofit educational associations and organizations, govern- 
ment agencies, businesses, and foundations. These groups must be encouraged to 
continue to input to and to use outputs of descriptive and evaluative data 
JrT^JwJ 0 a" Sp6Cial " eedS and interes *s. This cooperation should have as 
Kh!?!^ 10 !! ° r el f mination of some of the unnecessary overlaps of data 
bank activities and the provision of adequate coverage of all areas of interest 
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appendix: organizations named 



American Library Association (ALA), 50 E. Huron Street, Chicago, Illinois 
60611. f ' 0 

Association for Educational Communications and Technology (AECT), 1201 * 
16th Street, N.W., Washington, D.C. 20036. 

Association for Media Producers (AMP), 1707 L StTeet, N.W., Suite 515, 
Washington, D.C. 20036. 

Audio-Visual Associates, Inc., 180 E. California Boulevard, Pasadena/ California 
91105. • 

AVLINE. See National Medical Audiovisual Center. 

« • 
BALLOTS (Bibliographic Automation of Large Library Operations using a 
Time-sharing System), BALLOTS Center, Willow Trailer--SCIP, Stanford 
University, Stanford, C/alifornia 94305. 

Booklist. See American Library Association. 

R. R. Bowker Company, 1180 Avenue of the Americas, New York, New York 10036. 

Consortium of University Film Centers (CUFC) , c/o Tom Boardman, Visual Aids- 
Service, University of Illinois, 1325 S. Oak Street, Champaign, Illinois 
61820. , 

Educational Film Library Association (EFLA) , 17 W. 60th Street, New York,, 
New York 10023. 

I ■ 
Educational Products Information Exchange Institute (EPIE) , 463 West Street, 
New Yo'rk, New York 10014. ; 

Educational Resources Information Center (ERIC), National Institute of 
Education, Offide of Dissemination and Resources, Washington, D.C. 20208. 

ERIC Clearinghouse on Information Resources (ERIC/ IR) , Stanford Center for 
Research and Development in Teaching, School of Education, Stanford 
University, Stanford, California 94305. 

Jefferson Elemeiitary School District, 101 Lincoln Avenue, Daly City, 
California 94015. • . * 

J-MARC, Inc., ^758 Holloway Drive, Los Angeles, California 90069. 

Library of Congress (LC), MARC Development Office, 10 First Street, S.E., 
Washington,, D.C1 20540. 
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t0 on<Mf eleS County Schools » 9300 E. Imperial Highway; Downey California 

Macmillan Information, 866 Third Avenue, New York, New York 10022. 

• ' ° ■ - 

Media Review Digest (MRD) , Pierian Press, P.O. Box 1808, Ann Arbor r : „ 
, Michigan 48106. * 

HEDIAPILE. See Audio-Visual Associates . • 

National Audiovisual Center (NAC), National Archives "and Records Service, 
General Services Administration, Washington, D.C. 20409. 

Na ^i^L^ enter ° n Educational Media and Materials for the Handicapped 

(NCEMMH) , Ohio State University, 220 W. 12th Avenue, Columbus J Ohio 43210. 

llT?. 1 ^? nt ! r for Educ ational Statistics (NCES), U.S. Office of Education, 
400 Maryland Avenue, S.W., Washington, D.C. 20202. 

National Commission on Libraries and Information Science (NCLIsY 1717, 
K Street, N.W., Washington, D.C. 20036. 

National Information Center for Educational Media (NICEM) , University of 
Southern California, University Park, Los Angeles, California 90007. 

National Institute of Education (NIE) , U.S. Department of Health, Education 
and Welfare, 1200 19th Street, N.W., Washington, D.C. 20208. 

National Instructional Materials Information System (NIMIS) . See National 
Center on Educational Media and Materials for the Handicapped. 

^Iwil 1 Library ° f Medicin e (NLM), 8600 Rockville Pike, Bethesda, Maryland 

National Medical Audiovisual Center (RMAC), 1600 Clifton Road, N.E., Atlanta, 
Georgia 30333. A „ ' ^ ' 

Ohio College Library Center (OCLC), 1314 Kinnear Road, Columbus, Ohio 43212. 

Washington Library Network (WLN), c/o Ms. Mary Jane Reed, Associate State 
Librarian for Research and Planning (Automation) , Washington State Library' 
Olympia, Washington 98504. • . ' 
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appendix: references 



American Film Festival Guide. New York: Educational Film library* Association > 
1959- , annual. 

Apropos. Columbus: National Center on Educational Media and Materials for the 
Handicapped, The Ohio State University, monthly. (Information, position, 
papers, policies regarding NCEMffl.) 0 

Asheim, Lester, and Sara I. Feilwick, eds. Differentiating the Media (Studies 
f in Library Science). Chicago: University of Chicago Press, 1975* '/ 

Tke Booklist. Chicago: American Library Association, semi -monthly* 

Books in Print 1975. New York: R. R, Bowker, 1975 (annual updates). 

Books in Print Supplement: 1974-1976* New York: R. R % Bowker, 1975/ 



, Journals in Education. Educational Referees Information 
v York: Macmillan Information, monthly |i 6 * 



Current Index to. 

Center. New uuk, fjaLiimian nuyiuiatiuji, win/ ^ 



Doak, Wesley A.,, and William J. Speed. International Indpx to Multimedia 
.Information 19?0-19?2.^ Ne# York: R. R. Bowker, 1975.- (Formerly called 
Film Review Index.) • * ' 

Educational Technology: A Handbook of Standard Terminology and a Guide for 
Recording a%d Reporting Information About Educational Technology 6 . 
Eandbbok X. National Center for Educational Statistics (DHEW)*. Washington 
D.C.: U.S. Government Printing Office, 1975 (Stock &017-080-01502-1) . 

EPLA Evaluations. New York: Educational F.ilm Library Association, monthly 
(card format). 

EPLA Film Guide. See American Film Festival Guide. 

Film Evaluation Guide, 3 vols. New York: Educational Film Library Association, 
1965, 1968, 1972. 

Film Locator. Projected publication' beginning February 1977 by R, R. Bowker 
Company and the Consortium of University Film Centers, annual updates. 

Film Reviem Index. See Doak, Wesley A. 

Films y a MARC Forgot; Specifications for Magnetic Tapes Containing Catalog 
Records for Motion Pictures* Filmstrips* and Other Media Intended for 
Projection. Washington, D.C.: Library of Congress, 1970. 

# 

62 

58 , S3 



Bob to Use NmiS: The Key to Information About Instructional Materials for 
the Handicapped. Columbus: National Center on Educational Media and 
Materials for the Handicapped, The Qhio State University, 1976. 

Instructional Materials Thesaurus for Special Education. 3rd ed. Columbus- 
National Center on Educational Media and Materials for the Handicapped 
The Ohio State University, 1976. 

Irregular Serials and Annuals: An International Directory. 3rd ed.- New York- 
R. R. Bowker, 1974. - 

Johnson; Jenny K. Appraisal of Educational Materials for AVLINE: A Project 
of the Association of American Medical Colleges and National Library of 
Medicine.. Paper presented at the Health Education Media Association 
Conference, New Orleans, January 1976. 21pp. IR 003 232 (ED number not 
yet available). 

Landers Film Reviews. Los Angeles: Landers Associates (Box 67960, Los Angeles 
California 90069), monthly. (In-depth evaluative reviews of 16mm and 8mm 
films.) 

Limbacher, James L. Feature Films on 8mm and 16mm: A Directory of -Feature 

Films Available for Rental,, Sale, and Lease in the United States. 4th ' 
ed. New York: R. R. Bowker, 1974. 

Mayhew, Lewis B. Computerized Networks Among Libraries and Universities- An 
Administrator's Overview. Stanford, California: ERIC Clearinghouse on 
Information Resources, 1975. 76pp. ED 115 220 (83 * microfiche, $4.67 
photocopy). Also available from Box E, School of Education, Stanford 
University, Stanford, California 94305 ($3.00; check to. "Box E" must 
accompany order) . 

A Selective Annotated Bibliography on Library Networking. Stanford, 
California: ERIC Clearinghouse on Information Resources, 1975 ' 
27pp. ED 115 219 (83* microfiche, $2.06 photocopy). Also available 
from Box E, School of Education, Stanford University, Stanford, 
California 94305 ($1.50; check to "Box E" must accompany order). 
(Bibliography to accompany Mayhew, above.) 

The Media Literature Index. Possible future regular publication. Two 

^974° tyPe isSU6S P ublished b y Audio-Visual Associates, Inc., Los Angeles, 

Media Programs: District and School. Chicago: American Association of School 
Librarians; Washington, D.C.: Association for Educational Communications 
and Technology, 1975. 

Media Review Digest. Ann Arbor: Pierian Press, quarterly. 

Millard, William L. "Information Networks in Biomedicine. " Journal of Bio- 
communications , II (November, 1975), 7-14. 
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New Serial Titles 1950-1970, 4 vols. New York: R. R. Bowker, 1973. 



New Serial Titles 1950-1970: Subject Guide, 2 vols. New York: R. R. Bowker', 
1975. 

NICEM Indexes. Los Angeles: National Information Center for Educational Media, 
* undated periodically. Indexes are available on the following .subjects: 

' 16mm Educational Films Producers, and Distributors 

35mm Filmstrips Ecology - Multimedia 
Educational Overhead Transparencies Psychology - Multimedia 

Educational Audio Tapes * Vocational and Technical Education - 

Educational Video Tapes Multimedia " y 

Educational Records '« Health and Safety Education -.Multimedia 

8mm Motion Cartridges Black History and Studies -.Multimedia 

Educational Slides ' 

Selecting Media for Learning: Readings from Audiovisual Instruction. .Washington, 
D.C.: Association for Educational Commuhidttions and Technology, 1974*. 

Sightlines. New York: Educational Film Library Association, quarterly. 

Spaulding, C. Sumner, ed. Anglo-American Cataloging Rules. Chicago: American 
Library Association,* 1967. 

Subject Guide to Books in Print 1975, 2 vols. New York: R. R*- Bowker y 1975 
(annual updates). 

Swank, R.C. "Interlibj^ry Cooperation, Interlibrfcry Communications, and 

Information Networks --Explanation and Definition." Interlibrary Communica- 
tions and Information Networks. Edited by Joseph Jtecker. Chicago: American 
Library Association, 1972. 

Thesaurus of ERIC Descriptors. 6th ed. Educational .Resources Information 
Center. New York: Macmillan Information, 1975 (annual). 

<» 

Tillin, Alma M. , and William J. Quinly. Standards for Cataloging Nonprint ^ 
Materials. Fourth Edition. An Interpretation and Practical Application. 
Washington, D.C.: Association for Educational Communications and 

Technology, 1976. 0 ^ 

* •< 
Ulrich r s International Periodicals Directory. 16th ed. New York: R. R. Bowker, 
1975 1 

Yarborough, Judith D. Access to Nonprjnt Media: What Is and What May Be. 

Stanford* California: ERIC Clearinghouse on Information Resources, 1976. 
Paper presented at the Association for Educational Communications and 
Technology Annual Meeting, Anaheim, California, March 31, 1976. 14pp. 
ED 119 743 (83* microfiche, $1.67 photocopy).^ 

Items with ED numbers may be ordered from the ERIC Document 
Reproduction Service* P.O. Bqx 190* Arlington* Virginia 22210. \ 
Enclose a check for the listed microfiche or photocopy price* 
plus postage. fFor items with IB numbers* contact the ERIC * 
Clearinghouse cm Information Resources* or consult the relevant 
issue of Resources in Education. 
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